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FOREWORD 



In mid-1977, the Federal government began funding a 
program called "Cities in Schools , n a demonstration pro- 
gram to integrate human services in the inner-city. It 
would use the school as the focal point — "put the city 
in the school" — whence the name. In September, 1977, 
the American Institutes for Research was awarded a con- 
tract by the National Institute of Education to conduct 
an evaluation of the Cities in Schools Program. This is 
the final report of that evaluation. 

It is the last of a long sequence of evaluation re- 
ports, briefings, presentations at conferences, memoranda 
of interim findings, and seminars. It comes at the end 
of a participatory process that involved a Technical 
Review Panel to monitor our work, half a dozen "stake- 
holder" panels to help develop our marching orders, and 
continual interchange, formal and informal, with the CIS 
staff. The evaluation itself is now being evaluated (by 
the Huron Institute) to determine what has been learned 
about conducting this type of interactive evaluation. 

Throughout, our reports have catered to the needs of 
the people who were already involved in CIS, This time, 
in the final report, we address also the larger audience 
of people who want to know what has been learned about 
how to deal with the problems of urban schools, how to 
integrate human services, and how to take a program from 
demonstration to an established component of the system. 
For this audience, we treat CIS as a case in point. 

But which "case in point" that CIS represents shall 
we describe? We have choices. 

We may describe the CIS that the supporters of CIS 
see: a small group of dedicated street workers with one 
of the few original approaches available. 

We may describe the CIS that attracted a short 
flurry of national publicity because of President and 
Mrs. Carter* s support. 

We may describe the CIS of the social worker and 
youth counselor, who point to the intrinsic value of the 
services that CIS provides. 
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We may describe the CIS that was portrayed by offi- 
cials of the existing social service and school systems , 
of amateurs who are long on rhetoric and short on perfor- 
mance* 

We may describe the CIS that the CIS staff sees: an 
underfunded , hand-to-mouth effort that is trying to 
tackle some of the most intractable of our urban problems 
while fighting off bureaucratic interference and rival- 
ries. 

Each of these versions can be sustained by the 
facts. CIS did some things very well and some things 
very badly. Depending on how one values the different 
things , CIS can be seen as an extravagance or a neces- 
sity. 

Rather than write a report of the "On the one hand- 
...on the other hand..." genre, we begin with an overview 
of CIS (Chapter I), then proceed in the subsequent three 
chapters to give full play to each of three different 
approaches . 

The first of these is a contextual evaluation. CIS 
developed out of a particular set of circumstances and 
evolved over time. Chapter II describes this process, 
*^th emphasis on the practical and political factors that 
affected the program's implementation. 

The second of these is a traditional program evalua- 
tion: a statement of the program's accomplishments relative 
to the objectives that had been stated at the outset. Chap- 
ter III presents these results, drawing on data from pre- 
vious reports as well as from the 1979-80 experience. 

The third of the evaluation approaches is diagnos- 
tic . It explores what worked for whom in the CIS ap- 
proach, and attempts to estimate the potential of CIS's 
various elements. The focus in Chapter IV is on "What 
has been learned from CIS?" rather than "what did CIS 
accomplish?" 

Chapter V draws together the conclusions. 



Chapter I. 

The Cities in Schools Program: A Primer 



As the chapter's title suggests, this is an intro- 
duction to Cities in Schools (CIS) for readers who are 
unfamiliar with the program. Others may proceed directly 
to Chapter II without loss* 



CIS' PEKCEPTION OF THE PROBLEM 

CIS is a program to integrate the delivery of educa- 
tional and social services to inner-city students, using 
the school as a base of operations* The problem that 
motivated it is a familiar one. As we put it in the 
Evaluation Design ; 

Despite all the programs, all the money, 
and all the people that have been aimed at 
the problems of inner-city youth, a very 
large proportion of those youth apparently 
remain stuck in a cycle of failure, with 
"failure* defined in the elementary terms 

of an adulthood of stunted personal develop- 
ment, or destructive social behavior, or 
chronic unemployment, perhaps addiction or 
jail. 

CIS holds that current resource allocations would be 
sufficient to meet the needs of youth, if the delivery 
system were not fragmented and uncoordinated- CIS con- 
tends that the system 1 s ineffectiveness is a function of 
four defects: 

• lack of coordination : comprehensive 
needs cannot be met in one place? ser- 
vices are fragmented? 

• lack of personalism : s^nce each "client" 
deals with many "providers," no personal 
relationships are developed? 
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• lack of accountability : providers are 
rarely held responsible for failure or 
rewarded for success; and 

• lack of morale : both client and provider 
are apathetic about a system in which 
neither believes. 



As CIS sees it, this situation has many negative 
consequences. The system duplicates some services and 
neglects others, treating the client as a bundle of 
discrete problems to be addressed in isolation, rather 
than as a whole, person. Access to the people who need 
the services is limited because the initiative rests to 
an unreasonable degree with the recipient. He or she 
roust recognize the problem, learn about the service, find 
out where it can be obtained, travel to an unfamiliar 
place to seek help from strangers, and, too often, deal 
with an indifferent bureaucrat. For many people, these 
barriers are sufficient to prevent them from seeking 
help. The existing services that could aid the family's 
attempt to succeed are not tapped, and the cycle of 
failure continues. } 



CIS proposed an approach to correct these system 
defects. The central feature of CIS is the assignment of 
Caseworkers to groups of problem students at an inner- 
city school. The school provides centralized access to 
the youth, an entry point for access to the family, and a 
place to put the CIS staff. Because one of the major 
problems of service delivery for youth is finding them, 
CIS argues that services should be provided through the 
one place where they are legally required to be — 
building onto the public school, the institution that 
already is charged with playing a central role in the 
youth's development. 

The school provides the place. The caseload pro- 
vides the essential programmatic element. Each student 
in the program has one person on the CIS staff who is 
directly and comprehensively accountable for monitoring 
the student's well-being. If the student is absent, the 
CaseworKer is supposed to track him down. If winter 
comes and he has no coat, the Caseworker is to see that 
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he gets one. If the student cannot stay in school be- 
cause he has to help take care of younger siblings, the 
Caseworker is responsible for helping the family i..^ke 
other child-care arrangements. In short, CIS takes the 
stance that the Caseworker can never say of a problem, 
"It's not my job." The caseload is to be small enough 
(10 to 15 students) to make this degree of responsibility 
reasonable • 

There is a great deal of variation within this 
general model. The CIS schools include elementary 
schools, middle schools, senior highs, rnd street 
academies. Caseloads are .static in some schools, selec- 
ted during the summer and maintained throoughout the 
year. In others, caseload assignments are flexible? 
students are assigned to caseloads as problems crop up 
and are mainstreamed when the problems are resolved. 
Finally, the specific criteria for student selection vary 
from component to component.* In some components, low 
attendance or low academic achievement alone warrant 
inclusion in CIS; in others, a combination of these 
criteria, along with disruptive behavior, poverty, and 
other problems, are applied. One alternative school 
component in Indianapolis is specifically designed for 
delinquenc youth. 

But CIS has one distinctive structural approach that 
was the basis of its proposal for federal funding (IDC, 
1977) and still dominates its promotional literature. 
Internally, CIS distinguishes this approach from the 
variants by calling it the " pure form " We will also 
adopt that usage. The pure form of CIS consists of the 
two basic elements of the CIS structure — the school 
setting and the caseload — and a third element — unique 
to the pure form — the Family.** 

A Family consists of 40 students and four full-time 
staff. Each staff member has a caseload of 10 students, 
plus a specialist role. The four specialist roles are 
Youth Worker (also known as a Facilitator), who has 
overall management responsibility for the Family; 
Educator; Social Service Specialist; and Programmatic 
Specialist. Exhibit 1,1 shows CIS's complete description 
of each role and the kind of people who are intended to 
fill it. 

* "Component" refers to the program in a given school. 
**Throughout this report "Family" denotes the CIS Family 
and "family" denotes the students' kinship family. 
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EXHIBIT 1 .1 CIS Description of Family Staff Roles* 



FAMILY SI. *fF 

? t Family Staff's functions may be described in general terms as follows: 



CATEGORY PRIMARY FUNCTIONS 

Educator To serve as the educational resource within a grouping 

(family) of 40 students and 4 staff; required to 
provide diagnostic testing of students' academic 
needs, advise other staff members on individual 
problem areas, facilitate remediation where 
appropriate, and assist classroom teachers in 
supportive role, able to provide guidance, friendship 
and availability to the youth and develop personal 
relationships with 1 0 of the 40 students. 

Youth Worker To serve as the manager of a grouping (family) of 
40 students and 4 staff; able to supervise operation 
of the team, maintain attendance and grade point 
records on the 40 students, provide leadership of 
planning sessions involving the team staff, must 
display high degree of charismatic skill in relating 
tofouth in order to share personal relationship 
with all 40 students; make visits to students' 
homes and facilitate close contact and involvement 
with parents. 

Social To serve as the social service resource with a 

Service grouping (family) of 40 students and 4 staff; able 

Specialist to provide in-depth counseling of adolescent 

youth, diagnose the need for psychological testing 
of appropriate students, assist youth and their 
parents with social service needs, and prepare 
necessary records on students in caseload; able 
to offer guidance, friendship and availability to 
the youth and develop personal relationships 
with 1 0 of the 40 students.. 

Proaramrrtte To serve as the programs 'esource within a 
Special U grouping (family) of 4C and 4 staff, 

organize athletic, culture creational 
activities for the student/statf team, identify 
facilities in the community to be utilized for 
these activities, participate in team planning 
to oncdurage recreational events of an educa- 
tional nature and include activities encouraging 
involvement of students* parents and other 
family members; able to provide guidance, 
friendship and availability to the youth and 
develop personal relationships with 1 0 of the 
40 students. 



NOTE 

An Educator would serve as a 
licensed teacher, reading lab 
instructor, or professional 
tutor; could be loaned from 
community agencies specializing 
in educational fields. 



A Youth Worker could be a 
Boy's Club Supervisor, Police 
Athletic League Instructor, 
Girl Scout Representative or 
staff from a multiservice 
center; could be loaned from 
community agencies which 
generalize in the delivery of 
youth services. 



A Social Service Specialist 

could be juvenile probation 
officer, public housing 
advisor, welfare caseworker, 
psychologist or other profes- 
sional counselor; could be 
loaned from community 
agencies specializing in social 
service areas. 



A Programmatic Specialist 

could be a playground super- 
visor from the Department 
Parks and Recreation, YMCA 
athletic director, physical 
education coach or Junior 
Achievement instructor; could 
be leaned from community 
agenofes specializing in recrea- 
tionarand/or cultural fields. 



* Teken from Proposal for an Intagratad System of Human Sarvict Dativary, 30 March 1977. 
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The Family is the structural key to integration of 
services. The theory is that integration of services 
requires a specific person who is accountable to the 
student and his family and who cares enough about the 
student to identify his needs. This precondition of 
service integration is met through the caseload. By 
bringing together a mul tidisciplinary team of experienced 
professionals, CIS intended that Caseworkers would share 
their skills, knowledge, and experience. Students would 
no longer be assessed in terms of discrete problems, nor 
treated in a compartmentalized fashion. The end result 
would be that the student would receive help for the 
underlying causes of his behavior rather than simply for 
the symptoms. 

To ensure that this cross-fertilization of ideas 
took place, the pure form calls for weekly Caseworker 
meetings by content area (education, social services, pro- 
grammatics and youth work) and by Family (across content 
areas). In practice, some components scheduled Family 
work periods during school as well. Content meetings 
were used to track staff efforts and to bolster their 
skills in each content area. In essence, the Caseworker 
wears two hats: he is directly responsible for the 10 
students in his caseload, but he is also responsible for 
any of the 40 Family students who have needs falling 
within his content area. In practice, most of the respon- 
sibility was excercised within with the individual case- 
loads • 

Another structural feature of some pure form com- 
ponents intended to foster interdisciplinary help for 
students and to strengthen the Family unit is the 
"orientation class setting." This refers to a class 
consisting of the 40 students in a Family and the four 
Caseworkers. It provides the students and Caseworkers 
with an opportunity to interact with Family members 
outside of their caseloads and to conduct Family busi- 
ness, such as scheduling programmatic activities. The 
low ratios of students to staff are intended also to 
increase the amount of individual attention provided to 
each student. Subject matter taught in orientation 
classes varies, but it typically induces material on 
^careers, values classification, and decisionmaking. 

Given the context of the CIS framework, we now turn 
to the CIS program as it was implemented in Atlanta, 
Indianapolis, and New York in the 1978-79 and 1979-80 
school years. 
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THE IMPLEMENTED PROGRAM 



f^.,.^" 9 ., 1978 " 79 ' the second ful1 «<*ool year of 
nigh schools, three were -hininv- m ,k * ■ IUUA5 > were 
component in 1S79-80" 9 f ° r MCh CIS 

soae It tt2 9 «IiS? t SJ2r *"? and *""«>-PolL closed 
pons, P.s. 180 and P.S. 120 in New YnrV ™ ^ " 

Oakland, and Washington, D.c, Houston, 

These components include three distinct types of 
programs - pure form, also known as -Plan a- a Lll 

s^&sx ea s c ; p orth B ; S e a ?^ ;;™y^ - 

on u th %P ure form components th^re"^ ^ ^ S ^f s 



Plan A 



pure EX * i tH ? " ame f ° r the i-Ple^enteo 

Smith anS Ca^ve? f„ i?J, S X i^'" n 19 ^ 8- Z 9 . and 197 »- 8 ° " 

♦Detailed profiles of the projects in AM*n*- a 
Washington, D.C., were not part of the evalution! 
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TABLE 1*1 

1978-79 and 1979-80 Enrollment and Staffing in CIS 



CIS Components 



No. of frettoed * 

Sufcoa 



No. of Caseworkers 



1978-79 1979-60 



1978-79 1979-80 



ATLANTA 

Smith High School 
Carver High School 
Academy A 
Academy B 
Academy T 
St Luke's Academy 
Craddock Elementary 



98 
125 
110 

96 
100 

90 
120 



101 
105 

96 
133 
163 

88 
128 



11 
12 
11 
10 
10 
9 
10 



14 

13 
8 
9 
8 

8 
6 



TjtaJ 



739 



814 



73 



INDIANAPOLIS 



Arsenal Tech High School (Plan A) 


643 


634 


65 


53 


Arsenal Tech High School (Plan 8) 


310 


144 


39 


14 c 


Arlington High School 


60 




6 




Crispus Attacks High School 


71 




8 




Indy Preo 


29 


36 


5 


6 


School No. 101 (Jr High School) 


124 




13 




School No. 26 (Junior High School) 


74 


40 


8 


4 


School No 45 (Elementary) 


74 


71 


12 


7 


Total 


1,385 


925 


156 


84 


NEW YORK 










Julia Richman High School 


162 


199 


19 


29 


IS22 (Junior High School) 


120 


134 


22 


19 


PS 125 (Elementary) 


80 




6 




PS 180 (Elementary) 


60 




3 




PS53 (Elementary) 




70 




d 


Totil 


422 


403 


SO 


48 


HOUSTON 

M C. Wilhams Junior High School 




77 
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OAKLANO ' 

Hamilton Junior High School — 78 



WASHINGTON, D.C 

Terrell Jr High School — 157 — 9 

a The exact number of caw! odd students fluctuated from month to month, these figure* represent 
approximate 'eveis Curing the first semester 

b These figures do not include protect directors, and secretarial staff m 1979-80, Service staff who do not 
maintain caseloads are included only for the elementary and junior high programs. 

c Represents those Plan B staff with specific caseloads only 

d Mttsmgdata, 11 * X 7 



CIS's expectations.* The discussion centers on- the Smith, 
Arsenal Tech, and Julia Richman projects. 



The Settings 

CIS works with youth from inner-city neighborhoods 
in the "worst" schools — those likely to have high 
concentrations of the multiproblem students for which CIS 
was designed. The Plan A components in Atlanta and 
Indianapolis are located in areas that fit the inner-city 
stereotype. Both schools are in declining residential 
areas that had once been white middle class and had under- 
gone a racial and socioeconomic transformation in the 
1960s. The neighborhoods have high crime rates, deteri- 
orating housing and high unemployment rates. In the 
Smith neighborhood, for example ,-45 percent of the heads 
of households were jobless in 1975-76, less than 10 
percent of the families owned their homes, and the mean 
family income was $9,675. 

The site of the Julia Richman high school project is 
anomalous. The school is located in the fashionable East 
60s of Manhattan and was once a girls' school, with a 
student body drawn from the middle and upper classes of 
New York. Julia Richman now draws almost all of its 
students from Harlem, predominantly from East Harlem, 
with a few students who come all the way from the Bronx. 

All three of the high schools are large. Arsenal 
Tech is the largest, with approximately 4,500 students 
housed on a 74-acre campus. Julia Richman serves about 
3,300 students. Smith is the smallest of the^three 
schools with an enrollment of 1,100. 

The typical indicators of a school's rankings — 
mobility indexes, drop-out rates, attendance rates, and 
standardized tests ~ leave little doubt that Smith, 
Arsenal Tech, and Julia Richman represent the "worst" 
schools. In 1977-78, Smith ranked, next-to-last in per- 
centage of student attendance among the 22 high schools 
in the Atlanta Public School System (APS). It had a 
drop-out rate of 11.8 percent, the highest in the APS 
(the mean was only 4.9 percent). Smith ranked last also 

- _ ? 
"Among other things, the Principal changed the program's 
scope and functions to fit with other initiatives he was 
taking. These changes may have been good or bad, but the 
result was not a "pure form" project, 



among the 22 schools in all three subtest scores in the 
llth grade Tests of Academic Progress , given in the fall 
of 1978, The school's means on the subtest scores were 
all at or below a seventh grade equivalent, although the 
national norm is 11.1 and the Georgia norms ranged from 
9.4 to 10.1. Smith's "mobility index," based on student 
transfers, used as a measure of school stability, was 
.41, the third worst in the Atlanta system 

At Julia Richman, two-thirds of the student body 
read at least two years below grade level, compared to 44 
percent in the New York school system as a whole. More 
than a third (35 percent) of the student body left Julia 
Richman each year. Average daily attendance ran at 
roughly 68 percent. A third of the students were 
financially eligible for free lunches.* 

Students and Staff 

Students are selected for the program on the basis 
of poor attendance, disruptive school behavior, and low 
academic achievement in the preceding year. In 1978-79, 
the primary selection criteria were poor attendance and 
low reading scores, and to a lesser extent, disciplinary 
problems. In Indianapolis, where Title XX funds were 
used, poverty was also used as a selection criterion. 
Students whose Caseworkers were paid with Title XX monies 
had tb be "Title XX eligible," i.e., from families with 
incomes at or below the poverty level. CIS enrolled 101 
students at Smith, 634 at Arsenal Tech, and 199 at Julia 
Richman in 1979-80.** 

Table 1.2; displays the CIS students 1 age, sex, and 
race in 1979-80. The CIS populations at Smith and Julia 
RiGhman were almost entirely constituted of minority 
groups: black at Smith, and black with an admixture of 
Hispanic at Julia Richman. At Arsenal Tech, slightly 
more than three-quarters of the CIS students were black. 
Of the whites, most came from Appalachian backgrounds. 



^The Indianapolis public school system does not release 
comparative statistics on its schools. The judgment of 
teachers and administrators at Tech, plus our own 
observations, indicate that Tech is one of two hiqh schools 
with the most disadvantaged student populations in 
Indianapolis. 

**These represent numbers of students who at least 
registered at the beginning of the school year. 
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TABLE 1.2 

CIS Student Characterist ics, 1979-80 at Smith, Arsenal Tech, Julia Richman 

Smith Artanal Tech Julia Richman 



TOTAL STUDENTS ENROLLED 99 634 199 



Rtct 

Black 


100% 


63% 


71% 


White 


0% 


36% 


0% 


Hispanic 


/vv 
U70 


AO/ 
U70 


29% 


Stx 

Male 


55% 


49% 


47% 


Female 


45% 


51% 


53% 


Agt 

14 


3% 


18% 


2%* 


* 15 


36% 


31% 


21% 


16 


30% 


33% 


35% 


17 


23% 


14% 


28% 


18+ 


8% 


4% 


14% 


Gracto 

9 


42% 


43% 


92%* 


10 


34% 


36% 


8% 


if 


20% 


21% 




12 


4% 







# Age and grade breakdowns at Julia Richman are estimates. 

Females predominated in all of the sites except Smith. 
Most of the CIS high school students in 1979-80 were 
15-16 years old. The Julia Richman project served 
9th and 10th graders; Smith and Arsenal Tech included 
11th graders as well (Smith even had a few seniors) . 

Staff at the three projects were assigned to the 
four role specialities discussed earlier s programmatic 
specialist, educator, social service specialist, and 
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youth worker. Within each Family, the Tech and Julia 
Richman projects tried to maintain equal distributions of 
males and females, blacks and whites (plus some Hispanics 
at Julia Richman). 

The size of the Caseworker staffs increased during 
the last two years of the evaluation at Julia Richman 
and Smith. Julia Richman had a basic staff of 19 
Caseworkers in 1978-79 and 29 in 1979-80; the comparable 
numbers for Smith were 11 and 14. In contrast, Tech 
had 65 Caseworker? in 1978-79 and then, because of 
a funding delay, had only 53 Caseworkers (at most) in 
1979-80 — while the number of students in the program 
remained constant. 



The bulk of CIS's daily activities in the pure form 
programs can be grouped under four headings: counseling, 
human services, academic support, and special activities, 
as described below.* 



Counseling . Much of what CIS staff do during a ra^. 
falls into "counseling," defined broadly. Students talk 
to their Caseworkers nearly every day. They meet infor- 
mally in the halls," in class, during lunch, or after 
school. Attendance and school work are the most common 
issues discussed, and students and Caseworkers indicate 
that discipline problems aye also a frequent source of 
discussion. Personal and family problems are brought up 
less frequently. In addition to the individual contact, 
students in -grade 9 meet with the others in their Family 
during orientation class and with their caseload once a 
week in a group counseling situation. 

Arsenal Tech has a regular counseling center staffed 
on a rotating basis by social service Caseworkers. 
Students with particularly serious problems are referred 
by Caseworkers and teachers for individual or group 
counseling. Some stad'ents drop in on their own* In 
addition, the counseling center staff are responsible for 
students on probation. They serve as the liaison between 
the school and the court, regularly submitting atten- 
dance , grade, and progress reports to the probation 
officers. 



*The actual levels cf these activities are discussed in 
Chapter III. 



Routine Activities 
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fluman Services . The projects vary in the number and 
type of social services provided to the students (see 
Chapter III) but all of them engage in some routine 
service delivery activities. All three projects provide 
some preliminary health and dental screenings (i.e., 
pulse, temperature, blood pressure, eye checks, T.B. skin 
tests, sickle cell anemia, etc.) either through CIS 
nurses or referral to local health centers. Relief 
services such as book fees, bus tickets, and clothing are 
arranged when possible; and Smith has set up second-hand 
clothing shops. Other social service efforts include a 
preventive health project at Arsenal Tech that attempts 
to increase students' understanding of sexuality, contra- 
ception, disease and hygiene, and to provide drug and 
alcohol counseling on a small scale. 

Academic Support . In Plan A programs, CIS students 
are block scheduled with other CIS students for at least 
one class, with one exception. In Smith, CIS students 
were not grouped together for any classes in 1979-80, 
although they had been block scheduled for English, math, 
science, and social studies in the previous year. In the 
Plan A program at Arsenal Tech, students are together for 
math, English, reading, social studies, and orientation 
class. At Julia Richman, CIS students are grouped 
together for English, civics, orientation, and — in the 
case of the ninth graders with the lowest reading scores 
— Learning Center. Most of these classes are taught by 
CIS teachers. In the classes taught in an orientation 
setting, an entire Family is grouped together with the 
social service specialist, programmatics specialist, and 
youth worker assisting the CIS educator. 

In some cases, as with the reading lab and math 
courses at Smith, CIS grouping provider smaller class 
size and more individual attention than was otherwise 
available, but the majority of the blocked classes are of 
average size. In some instances, CIS also has put a 
Caseworker in the classroom, as a type of teachers aid. 
More generally, CIS sees "freeing teachers to teach" as 
one of it's major educational support functions. 

Special reading programs, . Smith, Arsenal Tech, and 
Julia Richman have special reading labs, staffed by CIS 
reading specialists and featuring individual instruction 
and class si2es of 3 to 15 students. In some cases, 
students are assigned to the Learning Center for an 
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entire semester. In others, students with reading 
problems or those lagging behind in a subject are 
generally referred to the reading labs (called Learning 
Centers) by classroom teachers for a specified time 
period — a few days to several weeks. Using both 
individualized reading materials and the assigned class- 
room work, the reading specialist works with the student 
until he or she is ready to return to class. Reading 
labs are seen as an adjunct to, rather than a replacement 
of, regular classes. 

Orientation . The CIS programs in Julia Richman and 
Plan A at Arsenal have "orientation" classes in which all 
four caseloads and Caseworkers from a Family are grouped 
together.* The Family educator plays the lead role in the 
class, but other Family staff teach when the subject 
matter is appropriate to their backgrounds. The content 
of the orientation class varies according to the site and 
the grade level. Orientation classes at Julia Richman 
and those for freshmen at Smith and Arsenal deal with 
careers, goal setting, decisionmaking, and values in an 
effort to increase students' awareness of themselves and 
the working world and to improve their decision-making 
capabilities. Arsenal Tech also has orientation classes 
for sophomores and juniors. The sophomore class receives 
one semester of health and one semester of drug educa- 
tion; the junior class consists of U.S. History I and II 
— courses that are required for graduation. 

Career education is an important element of orienta- 
tion classes. For example, a drug education class 
focused on criminal justice careers related to the 
criminal use of drugs. Representatives of the police 
narcotics squad, attorneys, court stenographers, and 
probation officers were invited to discuss their work. 
The class culminated in a trial with students role- 
playing. Another example is "Project Business," a nation 
wide program sponsored by Junior Achievement that was 
utilized in six orientation classes at Arsenal Tech. 
Twelve persons from the business community met with 
students weekly for a semester, presenting a practical 
approach to economics, money and banking, the market 
system, financial statements, career choices, and con- 
sumerism. 



^Regular credit is received for this course. In 
Indianapolis, the city school system has adapted the 
Orientation course for city-wide use for ninth graders. 
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Teaching approaches vary from traditional, struc- 
tured lecture classes to participatory, learn-by-doinq 
classes where the students are actively involved in 
lesson planning and implementation. An example of the 
latter is the "Pottersville* concept at Arsenal Tech. 
Students have researched various service jobs and have 
attempted to construct a human services delivery system. 
The programmatics program at a CIS elementary school was 
actually run by Tech CIS students who were participating 
in Pottersville . 

Tutoring . Caseworkers conduct tutoring sessions at 
all three pure form projects. Their efforts are supple- 
mented by volunteer and peer tutors in some cases. Since 
tutoring is conducted on an as-needed basis, there is 
wide variance in the frequency and length of sessions. 
Some students have regularly scheduled individual 
sessions several times a week, while others just drop in 
after school for a little help on a particular 
assignment. 

Home visits . Family involvement is an important 
part of the rationale of the CIS program, and the Plan A 
projects all require that the Caseworkers make periodic 
home visits (once a month has often been the norm). As 
discussed in Chapter III, the actual frequency of home 
visits has been highly variable. These visits typically 
involve telling parents about the program, getting 
permission forms signed, or discussing specific problems 
at school The home visits serve also to set the stage 
for providing services to the family. 



Programmatic activities . CIS provides an extensive 
array ot programmatic activities both in and out of 
school for students during the year. These activities 
range from flag football after school or a pizza with the 
Caseworker to trips and visits to museums and sports 
events. Some of the activities include the entire CIS 
student body, others the Family, the caseload, or simply 
one student. Caseload activities are scheduled at least 
twice a month, and a major Family or program activity 
occurs about once every three months. The activities 
that CIS has provided are discussed in Chapter III. 
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Plan B Programs 

"Plan B" refers to variants of the CIS approach as 
applied in the public school setting. In 1979-80, Plan B 
programs were in operation in three elementary schools, 
three junior high schools, and three senior high schools. 
Although the severity of the problems CIS is dealing with 
at the three school levels differs — incipient academic 
and behavior problems at the lower grade levels and full — 
blown attendance and academic problems at the upper grade 
levels — the approaches are generically similar. 

Plan B can best be described in contrast to Plan A 
or pure form. First, it is, less structured; students are 
not grouped into Families./ Second, Plan B Caseworkers 
are assigned to schools asf support staff for the entire 
student body or for a few 'grade levels, rather than for a 
specific caseload of students as in pure form. They 
perform the same functions as Plan A Caseworkers — 
counseling troubled youth, tutoring low achievers, 
arranging for social services, and providing programmatic 
activities — but they are not restricted to specific 
service recipients. In most Plan B programs, however, 
Caseworkers develop priority caseloads of students with 
particularly severe problems and work with them inten- 
sively on a short-term basis or, in some schools, through- 
out the year. Plan B Caseworkers do not have a regularly 
scheduled period to work with their students as do the 
pure form Caseworkers. Frequently, teachers release 
students from a class for tutoring sessions or counseling 
about in- class behavior problems, and Caseworkers catch 
students whenever they can to provide other types of 
help. 

In addition to providing help to individual stu- 
dents, Plan B Caseworkers perform support services for 
the entire school such as monitoring the halls and 
cafeteria, staffing in-house supervision rooms, nursing 
offices, and study halls. In one school, several of the 
Deans are CIS staff. Other foci of Plan B programs are 
neighborhood services and parent involvement. Staff are 
included in community organizing, liaison with members of 
the Parent Teacher Organization, and solicitation of 
community and parent support for student activities. 



*One of the programs classified as Plan B, School #26, 
did have a Family structure during its last year of 
operation. 
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The elementary school programs focus on academic and 
behavior problems. In some components, students are 
referred to CIS-operated learning centers for help? in 
others/ Caseworkers provide special in-class help or 
after-school tutoring. In both cases, Caseworkers are 
available to provide supportive assistance to teachers. 
They might lead small group discussions, tutor students 
who are lagging behind, counsel students about behavior 
problems, or simply help the teacher "keep peace." In 
components where staff are assigned to specific 
classrooms , Caseworkers meet reqularly wi th the teachers 
to discuss their progress with individual students and to 
develop strategies . 

The social service and programmatic activities 
provided at elementary schools varied accordinq to the 
predominant needs of each school. CIS arranged , for 
medical and dental screenings, operated clothing banks, 
and helped process applications ftfr book and travel fees 
or income assistance. Informal counseling was, of 
course, an integral part of all the programs, and some- 
times students were also referred for professional 
counsel ing . 

The junior and senior high Plan B programs resemble 
those in the elementary schools. Caseworkers provide 
tutoring, counseling, and programmatic enrichment activi- 
ties for priority caseload students, and to a lesser 
extent for the entire student body* Most components 
operate Learning Centers for tutoring during school and 
in-house suspension programs. Arsenal Tech also runs a 
program to encourage freshmen students to stay in high 
school. Staff encourage parental participation through 
tours, link students with alumni nientors, and train 
teachers in ways to encourage students to complete high 

school . 

Caseload students arc selected on the basis of poor 
attendance, low achievement, and behavior problems. The 
specifics (and the specificity) of the selection criteria 
varied by school and over time. 



Street Academies 

During 1978-79 and 1979-&0, the CIS proqram operated 
in four street academies in Atlanta and in Indy Prep, an 
alternative high school program in Indianapolis. 
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The Atlanta street academies are alternatives to the 
standard high school and were established to meet the 
educational and social service neeJs of urban youth 
unable to cope within a traditional school setting. The 
first Atlanta academies were founded over eight years 
ago. Four were in operation during this study: Academy 
A, Academy B, Academy T, and St. Luke's Area III Learning 
Center. Indy Prep was established in 1976-77. 

Although street academies are located in physically 
separate facilities, each maintains an affiliation with a 
high school in the public school system, preferably the 
one geographically closest. The high school gives 
diplomas to students who successfully complete a pre- 
scribed course of study. The academy serves as a place 
where the high school may refer students who experience 
difficulty adjusting to a standard school. * Credits for 
some extracurricular activities such as the drill team 
may also be granted by the public schools. Students are 
sometimes assigned to an academy by the juvenile court as 
a condition of probation. 

Staff members of the Atlanta academies represent 
both the educational and social service sectors. Total 
staff in each alternative program, generally number 10 or 
11 people (usually 4 or 5 teachers, 2 to 3 social service 
specialists, a streetworker, a project secretary, and a 
pro ject director). In addition, Atlanta has a Social 
Service Xoord i na tor " ami an Education CooLuinaloL who wutk 
with all four academies. Teachers and social service 
specialists counsel students, provide transportation to 
school or extracurricular activities (sports events, 
field trips, theater), and generally try to provide 
support and guidance* The teachers teach the academic 
classes and frequently all or part of the elective 
courses. Social service workers address a variety of 
student needs — such as court-related problems and 
referrals to social service agencies. They typically do 
not Work with the teachers in daily classes as in the 
pure form programs. 

Because the total population of each academy is only 
about 100, the 40-person Family concept is considered 
inappropriate. Academies are small and self contained , 
and staff and students tend to come in frequent daily 
contact with one another. 
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Students come to the Atlanta street academies from 
many sources: streetworkers searching for dropouts, 
public school officials referring "problem" students, 
parents seeking help for their children, staff of the 
other academies, social service aqencies referring 
students, and court officials seeking placement for 
delinquents. Students also learn about the academies 
from their frieads who like the flexibility of the 
program. Each academy serves approximately 70 to 115 
students. Ages range from 15 to 23, but there is no 
upper limit. Almost all of the students are black and 
1 i ve in poor ne ighbor hoods . 

Indy Prep is an intensi*"* program primarily for 
students who are on probation. It parallels the street 
academies in Atlanta with one major exception: The 
street academies are self-contained units that attempt to 
graduate students, whereas Indy Prep is an interim 
arrangement. Students are transferred irrto regular 
classes at the IPS Day Adult School after spending an 
adjustment phase at Indy Prep. Accordingly, students 
must be at least 16 years old, the minimum age for 
participation in the IPS Day Adult School program. Since 
the requirements in the Day Adult School program are not 
as stringent as those in the high schools, Indy Prep has 
broad flexibility in course offerings and hours. 

Indy Prep has five staff members: two are Facili- 
tators, one a Programma tr ics p e rson, - on e an Educator r -and 
one the Project. Director. In addition to the CIS staff, 
five teachers on loan from IPS Day Adult teach Indy Prep 
students on a part-time basis. Each staff member has a 
caseload of approximately six students, but the numbers 
vary as students enter and leave the program. Indy Prep 
is structured around the Family concept, but the project 
is so small that in practice it is a highly individual- 
ized counseling-tutor ing program. 

There is no formal selection process for Indy Prep. 
The program accepts any student who is unable to function 
in a regular school setting but willing to agree to 
follow the program rules. Twenty of the students in 
1978-79 were referred by the court and nine volunteered 
for the program after havinq been expelled or suspended 
from other high schools. , 
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Academic Program, Students in the Atlanta street 
academies attend basic classes — English, math, reading, 
science, and social studies — from approximately 9:00 am 
to 1:00 pm. Academies match their course descriptions 
and credits to those of the regular high school. At Indy 
Prep, students attend classes from 8:00 am to 4:00 pm to 
earn a normal seven credits per semester. The students 
are segregated from the other Day Adult classes but the 
content of the courses is similar. Courses offered by 
the IPS Day Adult School during the spring semester 
include math, English, reading, gym, music, science, and 
U.S. history and government. In addition, CIS staff 
teach orientation class and social studies. In all five 
academies, a great deal of time is spent in informal 
counseling and tutoring sessions. 

The alternative programs offer the same type of 
social services and extracurricular activities as the 
other CIS components. The small caseloads are intended 
to foster close Caseworker-student relationships, and a 
great deal of time is spent in informal counseling. 
Caseworkers visit students 1 homes periodically, and refer 
the students to service agencies as needs crop up. They 
also plan group and individual recreation and cultural 
activities with their caseloads. 



Chapter II. 
The Evolution of CIS 



CIS was a "demonstration program* a term that 
calls to mind a tidy process whereby a program package is 
designed to meet certain objectives, provided with enough 
support to give it a fair trial, and then evaluated. 
Like most demonstration programs, CIS had very little in 
common with this model. The program's accomplishments 
and failures occurred largely because of contextual 
factors that had nothing to do with the program's 
intrinsic merits or defects. This chapter describes the 
main elements in an eventful history. 



GETTING STARTED 

The program now called CIS grew out of the exp- 
eriences of a small band of activists — mostly white, 
male Christian streetworkers — .who went to Harlem in the 
early 1960s. They spent the rest of the decade working 
with the kinds of youths who laterr would be sought as 
clients of CIS.* 

Their work in Harlem eventually produced a set of 
"street academies," largely sponsored by corporate 
donors. They were alternative schools, dealing with the 
dropouts who could not succeed in the public school 
setting. Along with education, the staff of the street 
academies tried to make good on what was to be known in 

•Most of the historical material is drawn from 
interviews. For Atlanta, primary sources were: David 
Lewis, Ueil Shorthouse, Sandra Swans, CT. Martin, and 
Helen Branch. For Indianapolis? Harv Oostdyk, Stanley 
Stern, Betsy Baltz, Karl Kalp, Ray Reed, and Richard 
Lugar. For New York: Harv Oostdyk, Carolyn Smith, Bruce 
Spraggins, Tony Hernandez, Paul* Lipsitz, and Jewel 
Bickford. For the pre-CIS background: Harv Oostdyk, 
Willoughby (Wib) Walling, William Milliken, and Neil 
Shorthouse , 
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CIS as "personal ism" — the all-embracing responsibility 
of the Caseworker to know the student and get hold of 
whatever help was necessary. 

In the 1970s , the work shifted to Atlanta, where 
another set of street academies was set up, funded 
(improbably) by the U.S. Postal Service as one of seven 
such programs around the country. But as- their experi- 
ence with street academies accumulated-, the founders of 
CIS increasingly saw the standard school setting as the 
next step in reaching inner-city youth. Bit by bit, the 
notion of introducing Caseworkers into the school took 
hold, and by the mid-19 70s the idea had led to embryonic 
programs in Atlanta (where the program was called 
"Project Propinquity* ) and Indianapolis (where it was 
called "Tech }00 n ). By this time, an institutional 
umbrella had also been created: the Institutional Develop- 
ment Corporation (IDC), which would later be renamed CIS 
Inc. 

The details of how the footholds were carved out are 
described in Report No. 2 (pp. 16-50). Here, a brief 
description of: the people who were in charge will help in 
understanding later developments. 

Above all, it must be understood that the founders 
of CIS were committed to helping kids in trouble, and 
that this commitment dominated their stance toward the 
program, toward getting support for it, and toward their 
administration of it.* They were streetworkers. Tn this 
sense, the mission — to help kids" ~ antedated the 
solution. The founders were not social engineers with a 
solution who set out to find a problem to which it could 
be applied. Rather, they became convinced out of their 
own experience that the key to dealing with the dropouts 
and the delinquents and the losers was intensive 
one-on-one contact. Youth services had somehow to be put 
in a personalized context. 

The specifics about how this might be done were 
secondary to the essence of the logic: "Hire people who 

♦The statement applies to a shifting group of half a 
dozen persons who formed tne nucleus of the. program in 
its early years. In the discussion of priorities and 
style, "founders" refers primarily to William (Bill) 
Milliken and Harv Oostdyk, who have been the leading 
actors in developing the ideas and obtaining support. 
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feel as strongly about kids as we do, and put them in a 
structure where they will have access to them and access 
to service resources. * As time went on, the specifics 
took shape — the notion of -he 40-student "Family," of 
four staff from fourhuman services specialities, and the 
rest. But these were details, not essentials. 

The foregoinq hints at another defining 
characteristic of the founders: They were pragmatic and 
enterprising. They managed to carry on their work for 
almost a decade with only a smattering of Federal money. 
Throughout the period of the evaluation, the core 
organization (first called the Institutional Development 
Corporation, later changed to Cities in Schools) still 
operated entirely on donations — the Federal money went 
to the school systems, not to the CIS organization 
itself . 

Maintaining solvency in that way, for that long, 
required continual fundraising. CIS cast a broad net,, 
ranging from foundations tc large corporations to 
socially prominent private philanthropists on the New 
Yorfc/Washington axis. 

As the founders developed their financial sources of 
support, they also developed their political entree. It 
was always from the top. The Indianapolis program 
depended on the patronage of Mayor (now Senator) Richard 
Lugar. The Atlanta program got off the ground with the 
help of Postmaster General Blount, and was solidified 
through the active support of some of the city's most 
prominent financial and business leaders. In New York 
City, the program got started through a combination of 
old connections from the 1960s program, but this 
uncharacteristically within-the-system approach was soon 
buttressed by a direct- link with the Mayor's Office and a 
prestigious "Policy Board" headed by Howard Samuels, a 
prominent figure in New York politics. 

The program's penchant for working at the top 
political levels reflected a pragmatic judgment. The 
founders were challenging the existing human services 
structure. ' The challenge was not likely to be sponsored 
by the existing bureaucracy. Only directives from the 
top would force access, they reasoned. But the strategy 
also contained the seeds of later problems. For, if only 
pressure from the top could get the program started, only 
support by the existing bureaucracy — or at least a 



27 



32 



In this endeavor, the general goals of the System 
were to be: 

(a) to coordinate the delivery of services 
for the greatest benefit of the under- 
privileged; (b) to organize the delivery of 
services comprehensively around the needs 
of the whole person , the family unit and 
the community; (c) to allocate resources 
with benefit of information and advice 
drawn from local people who are familiar 
with the needs of their neighborhoods and 
communities ; and (t3) to proceed initially 
within the boundaries of existing programs. 
( Proposal , p. 13) 

The operational goals were stated as: 

1. Eliminating program duplication and 
consolidating common activities and 
programs. 

2. Creating an educational environment that 
develops the skills necessary for employ- 
ment in our free enterprise system. 

1. Providing a forum where the needs of an 
entire neighborhood can be expressed to 

the community power structure and 

through which new patterns of meeting 
these needs can be more fully developed. 

These were followed by a statement of "Specific Develop- 
mental Object ives,* as follows: 

As the System takes root it should bring about: 

1. An extension of the scope of service 
beyond the individual to the family and 
to the neighborhood; 

2. Greater intergovernmental cooperation 
among Federal , State , and local agencies 
and growing involvement and support of 
private organizations and individual 
volunteers ; 
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3. Better planning for use of existing 
resources at the local level so that the 
system draws upon the large base of 
established organizations and resources 
and uses only a negligible amount of new 
Federal funding; 

4. A demonstrably workable prototype of a 
more effectively integrated neighborhood 
based service delivery system, capable 
of surviving local political changes; 
and , 

5. A plan for limited replication of proto- 
types and for systematic testing and 
evaluating of those replications. 

( Proposa l 9 p. 18) 

Such was the rhetoric on which the fundinq of CIS 
was based. It is unclear how much of it should be read 
as the "real" intentions of the program. The confusion 
has arisen in part because the lead staff of CIS have 
never marched in lockstep on the specifics of its 
ideology. There is no such thing as doctrine. In that 
sense, any statement about the order of priorities is 
bound to be wrong J* But this is our best reconstruction 
of the consensus: 

In the most general sense — a n aspiration to brea k 

away from compartmentalized services and move toward a 
holistic relationship between service-provider and 
service-recipient — service integration was always an 
authentic objective. 

The objectives relatinq to neighborhood-wide forums 
and outlooks never had much life outside the confines of 
fc ^ e P roposal . They were general goals held by some of 
the leading figures in CIS, especially Oostdyk (who was 
one of the authors of the Proposal ) , but they never 
figured in the operations of CIS. 

The objectives relating to integration of services 
for the whole family, not just the CIS students, were 
very real at the beginning. Certainly they figure 
prominently in the Proposal : 

*See Repo rt No. 2 f pp. 11-15, for a detailed discussion 
of goals and objectives as perceived by the senior CIS 
staff. 
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Prototype development will emphasize the 
importance of the family and seek to 
strengthen the family structure. The 
ultimate target of services should be 
coordinated around families . ( Proposal , 
p. 20. Emphasis in the orig i nal . ) 

But, given the many difficulties associated with 
integrating services for even the student, plus the 
difficulties of gaining entree to the family, CIS staff 
'backed away from this objective in practice, consigning 
it to a category of "next steps 1 * once some other barriers 
had been surmounted. 

The objectives that dominated the day-to-day opera- 

tionS of the program were ones that the Proposal 
mentioned only indirectly: reducing absences, improving 
academic skills (especially reading), acclimating the 
students to the world of work (and the world in general), 
counseling, and providing ad hoc social service assis- 
tance as needed . 

This was the central disparity between the program 
described in the Pr o j ysa l and the prograffh that the val- 
uators came upon when we first started observing CIS in 
the fall of 1977: The ineans to an end — service inte- 
gration — held center stage in the Proposal, w hile t he 
end itself — to help kids in trouble ~- held center 
stage in the program that actually existed. 

When questioned on this point, the principals in the 
development of CIS respond with varying viewpoints. Some 
argue that there was no dissonance. The lesson learned 
from the 1960s was that the existing structure fot 
delivering human services was ineffective, but parallel 
structur.es (such as the New York street academies) could 
not be a replacement. The notion of service integration 
was the driving force behind CIS, and continues to be. 
Stfiers who were authors of the proposal tjave said that 
the function of the Proposal was to get funding, and 
service integration was a saleable theme. For them, 
service integration was an important but not primary 
motivation. They genuinely believed that their approach 
could provide improved services without increasing the 
number of social services employees. They genuinely 
believed that the isolation and piecemeal delivery of 
services impeded their effectiveness. But the incentives 
of economy and a more rational structure were not the 



mainsprings of their enthusiasm. Tf they had been told 
to put Caseworkers in the school , ar**J to forget about 
restructuring the social service delivery system, their 
motivation would have been essentially undiminished. The 
key notion, to reiterate, was to build a program that 
would enable intensive, daily interaction between Case- 
workers and kids.^ 

Whatever the order of "real" priorities, the written 
proposal before the White House and the funding agencies 
was unambiguously a proposal to begin the process of 
building a new configuration of human service delivery. 
It would use an operational component called "Cities in 
Schools" {its prospective organizational basis was left 
unclear) and a nonprofit consulting organization called 
the Institutional Development Corporation to begin this 
prototype work. It sought $2,6*74,000 in new Federal 
funds to round out a total projected budget of $5,915,000 
for the first year as a national program ( Proposa l , p. 
¥5). , 

The Proposal was dated 30 March 1977 and the 
President (who had been kept, abreast of its development) 
approved it on the same day, via a letter to the depar- 
tment heads who were prospective funders of the program. 
Tt read in part that "On March 30, 1977, I approved the 
proposal .as an -experimental effort aimed at developing 
an integrated system of human service delivery." A 
period of negotiations ensued. Finally, it became 
necessary for the President to send a letter to the 
cabinet heads of the seven departments that were to 
contribute support, explicitly asking them to support the 
effort. * 

In the. end, the seven agencies formed a .sort of 
consortium in sponsorship of the program. The Community 
Services Agency (CSA) was designated as the agency 
responsible for monitoring the implementation of the 

*The White House connection was instrumental in 
obtaining the initial funding. Tt did not have much 
effect on the subsequent implementation of the project. 
The Carters' support was the subject of media attention, 
especially when Chip Carter briefly joined the staff of 
CIS. But aside from Mrs. Carter's continuing interest in 
the progress of CIS (she visited all of the original 
sites), neither the administration nor the scope of 
the program was affected. 
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program, while the National Institute of Education took 
responsibility for the evaluation. 



ENTER THE EVALUATION 



The compet it ive procurement process for selecting an 
evaluator was completed in September, 1977. AIR was 
awarded a contract for a three year evaluation. The work 
was to begin with a six-month design phase. Then, the 
evaluation would collect data for three school years: 
1977-78, 1978-79, and 1979-80. In mid-course, the eval- 
uation would submit a full-scale interim report on the 
CIS process and its impact on the youths in the program. 
The technical aspects of the evaluation would be moni- 
tored by a "Technical Review Panel" chosen by the Eval- 
uation Research Society. And, from the outset, the eval- 
uation would be planned and administered in accordance 
with the needs and interests of the * stakeholders" in the 
evaluation process.* Stakeholders — people who had a 
stake in whether CIS worked ~ would consist of decision- 
makers who were to decide on the fate of the program, the 
clients (parents and studer ), and the CIS staff 
members • 

In October 1977, AIR 1 s evaluation team made its 
first round of visits to the three sites, beginning the 
six month design period. We talked to the stakeholders, 
assessed the state of the available data, and recorded 



evaluation design that expanded on the design presented 
in the proposal, and adapted it to the program that had 
evolved. 

In May 1978, we began systematic data collection in 
the three field sites, collecting end-of-year archival 
and interview data about the effects of the program on 
students faring the 1977-78 school year. 

The spring data colleption was intended primarily as 
a pretest of the data collection instruments. But as we 
examined the results with an eye to improvements in the 
way we obtained data, it quickly became obvious that the 
findings had important implications for the program as 
well. Judging from what we had been told by the Case- 



*" Stakeholder" is a t<*rm first coined by Edwards, 
Guttentag, and Snapper (1975). 



the state of implementation. 
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workers themselves, students in some sites had relatively 
few "problems" in the sense that CIS used the word, 
except that they were doing poorly in school. The 
incidence of CIS*s "service delivery" other than general 
counseling was very low. Few Caseworkers had developed 
much knowledge about the family situation. Often, the 
Caseworker had not even visited the family. 

More generally, the program that we were evaluating 
was not the one described in the Proposal , but a collec- 
tion of disparate activities in inner-city high schools, 
grade schools, middle schools, and street academies. 
Some of these activities were undoubtedly useful. Some 
bore a resemblance to the activities planned for the 
program. But in no sense was the evaluation going to be 
able to assess the validity of the CIS concept. The 
concept was not being tested. 

AIR communicated these results to CIS staff „ Part 
of their response was that the evaluators had not asked 
the right questions, or that the Caseworkers and students 
had not responded accurately. But another part of the 
response was to try to make the program work better the 
next year. A number of steps were taken to specify 
guidelines for Caseworker responsibilities and to arrive 
at explicit statements of what CIS was supposed to be. 

In particular, all three sites sought to tighten 

the criteria us e d to s elect the program's participants » 

Indianapolis tried to apply some hard-and-fast criteria: 
the student had to have shown at least a 10% absence rate 
or to have tested at least three years below grade level 
in reading, or to have exhibited documented behavioral 
problems* Atlanta did not apply formal criteria, but did 
end up with a set of youngsters who had severe academic 
and other problems. New York, which during 1977-78 had 
deliberately chosen an "easy" population of students 
(because the program was so understaffed) went to the 
other extreme and recruited the "worst-of-the-worst . " 

The extent of the modifications was limited, 
however. The CIS sites were accustomed to substantial 
autonomy and had always looked askance at standard- 
ization. Further, senior CIS staff themselves were not 
unanimous about strategy, nor were they temperamentally 
attracted to the notion of coercing uniformity in a 
program that had to work und^r such widely varying 
conditions. Thus, the ptoqram did not try to establish a 
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common format for the various schools, nor even a common 
nomenclature. No attempt was made to standardize a core 
set of activities or a core "curriculum" for the orienta- 
tion classes and. tutorial programs. 

The next maior checkpoint during the evaluation was 
the circulation of the draft of Report No. 2 , an assess- 
ment of administrative and process charac ter ist ics of the 
program, in April of 1979. The findinqs expanded on the 
t/pes of information that had been uncovered during the 
preliminary look during the summer of 19"?8, pointing to a 
variety of discrepancies between the program's imaqe of 
itself and the reality. Again, the CIS response was am- 
bivalent, with energetic efforts to change some aspects 
of the CIS operation in response to the findinqs reported 
in the draft, but also an intense — and tense, on occa- 
sion — dialogue with the evaluators about the justice of 
the findings. The final version of Report No. 2 con- 
tained a 20-page commentary on the report, prepared by 
several members of the staff and approved by Milliken 
(then President of CIS Inc.) as a statement of policy. 

The period between Report No. 2 and the analysis of 
program impact ( Report No. 1 ) released in February 1980 
was punctuated by a series of formal and informal inter- 
actions between AIR and the program staff, stakeholder 
groups, and] the national CIS Board. Report No. 3 trig- 
gered another round of these meetings* Throughout this 
p e riod, how ever r CIS wa s operating irr a con text ' ttnrt frad , 
it sometime* seemed, been designed to* prevent success. 
The ^valuation of what CIS had done was increasingly ir- 
relevant to the evaluation of what CIS could do. We turn 
now to the reasons for this state of affairs. 



IMPLEMENTING THE FEDERAL DEMONSTRATION 

From ^e beginning, CIS operated under a peculiar, 
probably unique organizational and fundinq scheme. CIS 
itself (meaning IDC) was initially supported entirely by 
private fundk. The projects in the many schools where 
CIS worked w^re under the administrative aegis of the lo- 
cal school system. The money for runninq the projects 
came from an array of federal and private sources -- as 
many as seven tederal agencies were contributing funds at 
one time or another. And, depending on the city, the CIS 
program might have personnel whose institutional homes 
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were scattered among a dozen municipal agencies, 
community-based organizations, and national organizations 
such as the Boy Scouts. 

The funding sources were not coordinated. ,The 
various agencies did not contribute co a common pot out 
of which a CIS program was paid for. Rather, each 0 
contributed under cr.e guidelines of its own grant 
programs, requiring CIS to comply with its particular 
objectives, reporting procedures, and payment schedules. 
Nor was funding automatic. CIS had to apply for each 
grant separately, and face the likelihood that the 
requested funding would be reduced, that it would not be 
awarded on schedule, and might not be awarded at all. 

Of the many results of this gerry-built foundation, 
four stand out. 

First, because the government agencies were slow in 
reaching funding decisions and in paying invoices, CIS 
was in a perpetual state of financial crisis. It was 
common for paychecks to be delayed. Tn New York, in 
1977, the delay once stretched over two months. s t a ff 
quit, or could not be hired under such uncertain circum- 
stances. In some cases, staff continued to work on a 
volunteer basis even when funding had tun out altogether. 
Apart from the many short-lived crises, the funding 
problem in 19*79-80 kept the Indianapolis program short of 
- sfca-f t , wh i 1 e t he number -of caseload participants remained 
the same. 

s" Second, CIS was constrained to hire marginal or 
inadequate Caseworkers. To some extent, good prospects 
were put off by the shaky, short-term prospects that CIS 
could offer. To some extent, the program was at the 
mercy of the choices of staff made by agency-officials 
who were to assign someone to work at CIS. To some 
extent, the small salaries made the program noncom- 
petitive with other job prospects. In Indianapolis, 
these factors were exacerbated by a peculiarity of its 
funding situation: about a third of its Caseworkers were 
funded out of CETA lines. And the people who were 
eligible for CETA jobs did not constitute a rich pool of 
qualified youth workers, remedial teachers, or social 
service specialists . 

Third, CIS was always in an ambiguous position with 
regard to the school system neither a part of it, nor 
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independent of it. I n some schools, the relationship of 
CIS and the Principal remained^ excellent nonetheless. In 
some schools, the program had to leave, either at the 
Principal's request or because CIS felt that the program 
had been compromised. But in all three school systems , 
CIS attracted suspic ion in some cases, open host il ity 
— by senior officials. Much of this could be ascribed 
to their genuine skepticism about the program. A 
substantial portion of the resistance , however, seemed a 
natural reaction of a bureaucracy {or any organization) 
toward a program that was operating on its turf, but not 
wholly under its control. 

Finally, the financial and organizational setup was 
a continual drain on the attention and energy of CfS 
managers, CIS was not an administratively top-heavy 
program. A few r managers , with modest clerical support, 
were trying to keep the many grant applications flowing, 
the finances in balance, and still attend to the 
day-to-day administrative tasks of running a -compl ica ted 
program. One of the major complaints of outsiders who 
worked with CIS was its sloppy management. This impres- 
sion remains one of the strongest sources of opposition 
to the program. But seen dispassionately, ClS's failings 
(and there were some) were multiplied by the tangle of 
administrative requirements created for them by the 
funding structure . 

It is within tnis context that the progress of the 
program must be viewed. Th^ details of the history are 
recounted in Report No. 2 (pp. 16-71). The highlights 
that should be remembered in interpreting the subsequent 
chapters are as follows. 

The New York proqram was volatile throughout the 
1077-80 period. Two elementary schools were dropped from 
t>:<* program — one because the promised staffing /fever 



with the Principal. The overall management of the New 
York program shifted frequently. At Julia Richman alone, 
the program went through four directors during the three 
years. Julia Richman also underwent periodic shifts in 
its programmatic emphases. Some of these changes were 
constrained by events — lack of personnel being a 
primary factor. Others were a function of the exuberance 
o*i the program's leadership: new and better additions to 
the CIS procedures and services were conceived, perhaps 
tried out, then dropped or replaced with yet another new 



materialized, the other 
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idea. Structurally, the New York program made maior 
gains in its efforts to obtain staff from the established 
social service agencies — ' but again found itself ham- 
strung when the promised personnel did not show up when 
promised • 

Of all the changes in the Julia Richman program, 
perhaps the most dramatic was in the nature of the 
students in the program. In its first, pre-federal year 
(1976_77) r the program had taken on the students with the 
most difficult problems, with only a skeleton staff to 
deal with them. Most of the students dropped out? or, 
more accurately, most of them never were attending school 
enough for the program to start to deal with them. Tn 
reaction, the program deliberately chose students with 
relatively good records when it beqan the 1977-78 school 
year, only to be told by the evaluators that the students 
appeared to have so few problems that it was difficult to 
determine why they were in the program. Tn subsequent 
years (1978-80), with a larger staff (or promises of a 
larger staff), the Julia Richman program again took on 
the toughest cases. As we will discuss in subsequent 
sections, the magnitude of the problems of these students 
was sometimes so great that they raise the question of 
whether any one program could deal with them, no matter 
how well implemented. 

The Atlanta program added a new school, Carver High 
School, durinq the 1977-78 school year. Otherwise the 
Atlanta program remained structurally much the same over 
the three years, continuing programs in four street 
academies, an elementary school, and Smith High School. 
The major events were internal, involving the relation-^ 
ship of the separate projects to the administrative 
umbrella (EXODUS, Inc.), and the administration of the 
projects themselves. The project at Smith High Sc'hool 
underwent an administrative overhaul over the course of 
the 1978-79 and 1979-80 school years. 

Indianapolis was by far the largest of the three 
programs. Tn Tech High School alone, 500 students were 
carried on caseloads in Plan A (or "pure form." See page 
7 ff). As in New York, the Indianapolis program had a 
tendency to change focus — new twists (e.g., Green 
Carpet, Plan B) were added, then revised. But during the 
1978-79 school year in particular, Indianapolis made a 
major effort to implement the basics of the "pure form" 
according to all the specifications of the rhetoric. It 
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was during that year that the Tech program also produced 
the best evidence of positive impact on the students, and 
hopes were high that these accomplishments could be 
validated and improved in the 1979-80 school year. Then 
a teachers 1 strike immobilized the school system for the 
first two months of the 1979-80 school year. And key 
federal funding efforts were delaved, leavinq the program 
at a fraction of its planned staff for the rest of the 
year. 

Nationally, CIS started the period of federal 
support with the attitude that the iron was hot. Through- 
out 1977 and 1978, national staff were busy traveling to 
prospective replication sites. All three cities were 
hosts to numerous "tours" by outsiders, ranging from 
local school officials from other jurisdictions to the 
head of the federal Office of Education. Nev proqrams 
were established in Oakland, Houston, and Washington. 
Plans were underway for several others, Tn 1979, these 
efforts were deliberately cut back. The problems in 
orchestrating the programs in place were already keeping 
the staff fully occupied. 

At the same time, CIS made a concerted effort to 
respond to criticisms of national management. An execu- 
tive vice-president (formerly the director of the Oakland 
program) was hired* to direct administration of the 
national program. Technical assistance on administration 
and planning was obtained. A comprehensive "five-year 
p]an" was developed. Staffing and budgeting priorities 
were identified. Staff training and development activi- 
ties were stepped up. 

The learninq process was visible. CIS at the end of 
the 19^9-80 school year was identifying problems and 
responding to them in ways that were not part of its 
pre-1977 repertoire. The programs in the expansion sites 
were reported to have sidestepped many of the problems 
that were encountered in Atlanta, Indianapolis, and New 
York. In short, CIS could argue in 1980 that it was 
ready to be evaluated. 

But the evaluation was not starting in 1980? it was 
ending. And as this history should have indicated, the 
evaluation was dealing with a program that was only 
partly implemented. Each of the critical elements was 
present in some of the sites, at some times; but not all 
of the elements were present in any one site over the 
period ol the evaluation. 
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This history raises a fundamental question. The 
reason that CIS was funded as a federal demonstration 
program was the belief of its advocates that it repre- 
sented an innovative, potentially important tool. All 
agreed that this belief deserved to be tested. But the 
test was conducted in a way that seemed calculated to 
undermine its value. The barriers were not the "natural" 
ones that established programs must cope with as w ell, 
but barriers that are characteristic of demonstratio n 
programs . 

None of this is new to CIS, Readers of evaluations 
will find the refrain a familiar one: "We are unable to 
assess the potential of the original, concept because of 
implementation difficulties." Insofar as CIS is not an 
isolated example, but the latest in repetitive history of 
similar histories, the account presented above may be 
more pertinent to the way the federal government supports 
demonstration programs than to the specifics of CIS. 
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Chapter III. 
The Accomplishments of CIS 

/* 

In this chapter, we apply the traditional criteria 
of program evaluation. We ask? Did CIS accomplish what 
it proposed to accomplish? We summarize the findings 
that bear on this question. In Chapter IV*, we shall go 
on to the question pf the program's potential. We shall 
probe the limits of what might be accomplished with the 
CIS approach. Here, we confine our remarks to that which 
actually was. 

* * * * * 

* 

When a demonstration program such as CIS seeks 
federal support, it necessarily makes three assertions: 
that the program will implement activities of a certain 
type and quality? that, as a result of those activities, 
it will produce some important benefits? and that it is 
affordable. By demonstrating the validity of these 
assertions, the demonstration lays the groundwork for 
institutionalizing the program once the federal pilot 
funding encts. In the evaluation design, we converted 
these general assertions into the following for CIS: 

• CIS will provide a superior structure and 
process for integrated service delivery 
to disadvantaged youngsters. 

• This higher quality of service will lead 
to significant, positive impact on the 
youths in the program. 

• These positive benefits can be achieved 
without excessive increase to costs of 
present alternative delivery systems 
(which produce less benefit). ( Evalua- 
tion Design, 1978, pp. 1-2) 



We used these assertions as the basis for deciding 
on the specific outcomes to be examined in l:he evalua- 
tion. These have been our findings: 

ASSERTION NO: 1 

"CIS will provide a superior structure and process for integrated 
service delivery to disadvantaged youngsters. " 

In its proposals for funding, its presentations to 
potential donors, and in its brochures and other public 
documents, CIS has used a commonly understood definition 
of 9 integrated service delivery. 9 The statement in CIS's 
current promotional brochure is clear and representative 
of CIS f s current thinking:^ 

Last year America poured over 300 billion 
dollars into programs' for unemployment, 
education, hunger, health care, drug and 
alcohol abuse — a patchwork of uncoor- 
dinated social services. 

Cities in Schools has figured out a way to 
coordinate these resources and put them 
into the lives of people who need them 
most. 

It operates in one central location: the 
city public school. 

So if you* re a young girl with a drug 
problem or a city mother worried about her 
son's first arrest, getting help can be as 
easy as going to school.*.. O 

It works like this; The students selected 
for a Cities in Schools v program attend 
classes with the other kids. Outside of 
class, they report to special counselors. 

These counselors monitor their student's 
schoolwork. They provide remedial educa- 
tion and lots of encouragement. They plan 
sports activities and field trips. If one 
of their students skips class, they find 
out why and try to do something about it. 
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The Cities in Schools counselors are all 
kinds i. f people. They are licensed reading 
instructors, job counselors, or Scout 
leaders. They are lent by the city or 
selected from other agencies. 

Instead of working all over the city, they 
work full time in the schools. They free 
the teachers to teach , and they give the 
kids support- that may get them through 
school and out of the welf arerunemploy- 
ment-drug cycle. 

Cities in Schools is more than an 
educational program. It reaches outside 
the school , to the community. 

Each counselor is responsible for a group 
of students of his very own. He knows 
them, he knows their families. 

He speaks their language and understands 
their way of life. He puts them in touch 
with job possibilities, financial and legal 
aid, health care and housing, and if * 
necessary ^ drug rehabilitation. 

Cities in Schools counselors are not 
miracle workers. They are advisors, 
referees, role models and friends. Most 
important, they f re always there. 

What they have to give are the resources of 
existing federal, state, and local social 
service programs — delivered in a personal 
way. (CIS, 1979, unpaginated) 



The statement operational lzes the program's service- 
delivery functions. According *to CIS, Assertion #1 will 
be made valid in the following ways: 

• CIS will deal with students who have 
serious, probably multiple problems. 

• CIS will provide Caseworkers trained in a 
variety of skills. 
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• The Caseworkers will develop close 
personal relationships with the students, 

• The Caseworkers will monitor attendance 
and school performance, and provide 
remedial help as needed, 

• The Caseworkers will provide enriching 
extra activities such as sports and field 
trips, 

• The Caseworkers will orchestrate the 
delivery of social services as needed. 

How wVll did the program mirror this image?* 

CIS will deal with students who have serious, probably 
multiple problems , 

fSo if you're a young girl with a drug* 
problem or a city mother worried about her 
icon's first arrest...,* 

Since the outset of the 1978-79 'school year, this 
expectation has been met substantially at all three 
sites, and almost universally at Julia Richman and smith . 
In all three cities, a reading of the complete file on 
each student almost invariably indicated severe academic 
deficits. More important, the students also showed very 
high incidence of nonacademic problems. 

To estimate the incidence of nonacademic problems, a 
rating procedure was employed. Three members of the 
evaluation \staff reviewed the complete file of each 
member of the interview samples (Caseworker and student 
structured Interviews, intensive interviews, documenta- 
I 

*The evaluation 1 s data on this subject consists of: (1) 
CIS*s data oh service delivery from its own management 
information system, (2) AIR's reconstruction of service 
delivery froA the case records of students in the sample, 
(3) structured interviews with students, (4) structured 
interviews with Caseworkers, (5) narrative descriptions 
by students, Caseworkers, and parents for the "intensive" 
sample. The T intensive" sample was a subsample of 
students whoso CIS experience was investigated through 
supplementary ^interviews. See Appendix A. 
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fho rTS Mies, and school records), rating each 
tion from the CIS nw ' a three-point scale of 

of the problem categories on a problem. " 

•severe,- 'f^S^ re Sisc"SsseS among the. raters. As a 
Questionable cases were u required either direct 

rule of thumb, a "severe rating ^uir tudent , s 
evidence that the problem ""J£; e ^% lthdraw „ after 
behavior (e.g . , ■ J*"** reasonable Expectation that the 
death of the father) or a « living 

P p r«ir rXc\TolZ^L l^s are show, in 



Table 3^1 below. 



T „«"u^ of S, U *n» -Wlh«**H*" - 



PROBLEMS 



Emotionally Withdrawn 

Emotionally Aggressive 

Economic 

Family 

Other 



No "Severe" 



Smith 
(n-44) 


Afisml Tech 
(n - 134) 


Julia Richmwi 
(n-54) 


9% 


15% 


13% 


34% 


32% 


50% 


36% 


26% 


56% 


50% 


26% 


50% 


39% 


27% 


33% 


7% 


45% 


15% 



♦h», 100 because of multiple "severe" problems among some students. 
Percentages sum to more than 100 because or mu.iv 



As the table indicates ^J^^SSSJS.'S 
Julia Richman and Smith P^ams had , 
all categories. Perhaps tne » j lia Ric hman 

that 93% of the Smith sample and 85% of ^e^, nQn _ 
sample were rated as having at ^ very geyere 

academic problem. severe 
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indeed. At Tech, only 55% of the sample were rated as 
having at least one severe nonacade;sic problem. This 
reflects partly the constraints of funding: Much of 
Tech's support was provided through Title XX, which 
provides funds for families that me*t a financial 
"poverty* criterion. Thus, CIS at Tech found itself with 
a large number of students who were poor and had academic 
problems — but who otherwise came from stable homes with 
supportive parents, and who had no abnormal behavioral 
difficulties. In part, the lesser incidence of students 
with severe problems at Tech may also reflect the nature 
of the context: inner-city Indianapolis does not have 

the same level of urban problems as inner-city Atlanta or 
New York. 

The estimates in Table 3.1 are probably lower 
bounds. Many of the "no evidence of a problem" ratings 
could represent lack of positive information rather than 
persuasive evidence that no problem existed.* 



CIS will provide Caseworkers tra ined in a variety of 
skills . ■ 

"The Cities in Schools counselors are all 
kinds of people. They are licensed reading 
instructors, job counselors, or Scout 
leaders. They are lent by the city or 
selected from other agencies." 



"Did the CIS students represent the bulk of the students 
in those schools who had such severe problems? We can 
only guess about this as about so many other aspects of 
the evaluation that would ordinarily have called for 
comparative data. In this instance, the ordinary 
barriers — the regulations calling for parental 
permission, and the very low return rates on parental 
permissions in these schools — were only one factor. An 
equally important barrier was that the personal problems 
in question were not ordinarily known by teachers or by 
other school personnel, nor could we expect them to 
emerge from a one-time interview with the student. 
Dossiers from the welfare agencies were not open to us. 
In short: on this topic, no data collection strategy for 
comparison data was both affordable and legal. 
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At the basic, structural level over which CIS had 
direct control, the Caseworker structural model was 
implemented as planned . Caseworkers were hired, assigned 
caseloads of 10-20 students, and were given a broad 
charter to deal with the problems of that student, what- 
ever they might be. These staff persons were generally 
grouped into four-person teams, as the plan intended. 
Although there was variation across and within sites, 
these teams generally conducted regular staffings of the 

caseloads and otherwise attempted to take advantage of 
the multiple-staff setup. 

Expectations for the training and expertises of the 
Caseworkers were not jaet in any of the three sitesT . Each 
site had a few trained personnel, but these were out- 
numbered by a large majority of Caseworkers who came to 
the job with very few special qualifications. These 
findings were discussed in detail in Report No. 2 (pp. 
74-82, Tables 4.1-4.3). Some of the leading characterise 
tics were as follows: 

• More than a quarter of the Caseworkers 
had not completed colle?*?. 

• Among the specialist categories in the 
Family staffing, only the educators were 
typically trained for that job (69%). 
Only about one in three of the social 
service specialists, one in four of the 
youth workers, and one in five of the 
programmatic specialists had appropriate^ 
specialized training. 

• The availability of persons with training 
and experience in the critical areas of 
remedial education (as opposed to, general 
teacning training) and psychological 
counseling (as opposed to informal 
counseling experience) was very low* 

As noted elsewhere, CIS's latitude in this area was 
narrow: both the salaries and the job security that CIS 
could offer were unattractive to trained, experienced 
people. This situation did not change after the analysis 
in Report No. 2 . Of the new Caseworkers hired since 
then, only 25 percent have specialized training in the 
major skill categories (social work, counseling, remedial 
education, remedial reading, recreation, nursing, 
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juvenile delinquency services),* Many of the others had 
some experience — acting as a counselor at summer camps, 
running recreation programs for the parks department. 
But evfcn when this experience is taken into account, 
almost half (48%) of the new hires showed no qualifi- 
cations for the job, either in training or job experi- 
ence* 



The program did make substantial progress in enlisting 
the participation of social service agencies" ! As shown 
in Tables 3,2 and 3*3, Atlanta and New York were especi- 
ally successful in obtaining outstationed staff. The 
large majority of these positions were accompanied by 
some sort of financial subsidy for the agency. Not 
surprisingly, the agency officials who were interviewed 
consistently reported that their budgets were tightly 
constrained, and that they could not afford to Outstation 
staff to CIS if the subsidy ended.** 



The Caseworkers will develop close personal relationships 
with the students . : ~~~ 

"Each counselor is responsible for a group 
of students of his very own. He knows 
them, he knows their families. He speaks 
their language and understands their way of 
life.... Cities in Schools counselors are 
not miracle workers. They are advisors, 
referees, role models and friends. Most 
important, they're always there." 

On this dimension, the accomplishments of CIS run to 
extremes . For a minority of students, extremely close 
personal relationships developed between Caseworker and 
students. For another set of students with few problems 
or neecJ to interact, there was relatively little contact, 
but this is not necessarily a problem — Caseworkers 
might appropriately be concentrating their efforts on the 

w The definition of "specialized training* is loose: a 
BS with a major in social work was counted, for example, 
as were partly. completed graduate programs. 

**For more on relationships between CIS and the existing 
social service agencies, see Report N o . 2, pp. 127-138. 

/ 
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TABLE 3.2 . 

Number of Staff Assigned from Agencies at Smith, Arsenal Tech, and 
Juiia Richman in 1979-80* 


1 






PLAN B 

AQtncy PLANA Other 

Caetworker fluff Caseworker Staff 




- 




ATLANTA - Smith High School 

Fulton Co. Department of Family arKJfChildren's Services 

Department of Human Resources 

Atlanta Public Schools 

City of Atlanta Police Department 

Mennonite Central Committee 

Total Agency Assignments 

Percent of Total Caseworker Staff (13) 


1 0 

1 0 
4 0 

2 0 

1 n 
1 0 

9 0 


9 
69% 




r 


INDIANAPOLIS - Arsenal Tech High School 

Near East Side Multi-Service Center 
Community Action Against Poverty 
C ha ruber of Commerce 
Indianapolis Public Schools 1 

Total Agency Assignments 

Percent of Total Caseworker (Plan A& B) Staff (95) 


8 0 
0 3 
0 1 

5 ' 0 

13 4 


17 
18* 


> 




NEW YORK • Julia Richman High School 

New York City Youth Board 

New York City Human Resources Administration 

New York City Board of Fducetion 

New York City Police Department 

Inwood House 

Interfaith Neighbors 

Total Agency Assignments 

Percent of Total Caseworker Staff (20) 


4 1 

5 1 
5 1 
5 0 
0 1 
0 2 

19 6 


25 

86% . 




- 


1 Indianapolis Public Schools contributed 5 teachers to CIS who maintained small (1-3) caseloads 
due to the under staff ing 

* Numbers in this table include staff from agencies regard (as? of the source of their salary^ 


•< 






students with the greatest needs. For a third set of 
students, Caseworkers failed to develop the expected 
personal relationship, despite the need to do so. The 
problem from an evaluation standpoint is that it is 
impossible to distinguish with confidence between 
students in the second and third groups. In short, we 


» 
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TABLE 3.3 

Source of CIS Staff Salaries at Ail Schools, 1979-80 





Administrative 
Staff 


Gtoeworker • 

OUiT 


p«*- — 

Other 

Caseload Staff ** 




ATLANTA • SmMi Cant. 4 Academies, Craddock, 








=■;- . - # 


Right to (toad Academy, Youth Conservation 










wonpfntfiity imprOfwiwiPi ■ ruppcf f Mnwi mmifi 










Office 
















u 


40 Z/J 


HUH/HOI 


A 
H 


0 


3 


•** 
7 


VISTA 


n 

V 


u 


A 


«f 


Futtfin ftv Don't nf Familu anH f^hiiHrAn** 










Services 


0 


2* 


0 


2 


Title XX* Department of Human Resources 


9 


16 


0 


25 


Atlanta Public .-Vhools 


0 


16 


0 


16 


United Way /Boys Club 


l 4 


1/2 


0 


1 1/2 


Atlanta Housing Authority 


0 


1/2 


0 


1/2 


Boy Scouts of America 


0 


1 


0 


1 


CETA 


0 


2 


0 


2 


CHy of Atlanta Police Department 


0 


2 


0 


2 


Discovery Learning. Inc 


0 


1/3 


0 


1/3 




98 


64 


7 


107 



Includes only staff with specific caseloads 

Includes staff of the Youth Ccnservatioi. Community 

Improvement Project and VISTA Community Organizers. 



1 includes half rhe salary of two people. 

2 Includes 1/3 the salary of 3 people, 2/3 the salary of one 
penon. and 1/2 the salary pf 2 people, 

3 Includes 2/3 the salary of 3 peopla. 
includes 1 fl the salary of 2 people 



INDIANAPOLIS Arsenal Tech Plan A and Plan B, 










Indy Prep, School No, 29, School No. 46, 










Title XX 


3 1 


19 


12 


34 


CETA 


3 


19 


13 


35 


Of f tee of Education 


10 1 


15 


0 


25 


0E * Community Action Against Poverty 


0 


0 


3 


3 


Tttte XX * Near East Side Multi- Service Center 


0 


8 


0 


8 
9 


Title XX - Indianapolis Public Schools 


3 


6 


0 




19 


87 


28 


114 



Includes only staff wan specific caseloads in Plan A-Arsenal 
Includes Plan 8-ArseneJ Tech Staff. Plan B* staff do maintain caseloads, but they 



includes 1/2 the salary of 2 people. 



NEW YORK CITY * Julia Rjchman 










Office of Education 


3 


2 


1 


6 


New York City Youth Board 


0 


4 


1 


5 


New York City Human Resources Admtn. 


1 


5 


0 


6 


New York City Board of Education 


1 


5 


0 


6 


New York Oty Police Department 


0 


5 


0 


5 


In wood House 


0 


0 


1 


1 


inter faith Neighbors 


0 


0 


2 


2 


VISTA 


0 


0 


3 


3 


TOTAL 


5 


21 


8 


34 



Include! only staff with specific caseloads. 



Iretudes VISTA volunteers working in itudenu' neighborhood*. * teecher in the learning Center 
* Socal Worker Coodinetor, e School end Grade Coordinator. • pert-time Social Worker for * 
pregnancy prevention group, two Couneetori end one school-wide Services Corrninator 
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can describe the level of contact between Caseworker and 
student, but statements about the quality of the relation- 
ships over the entire sample are problematic. 

*We start with the reports of students, whom we 
interviewed. Their responses suggest that most of the 
r elationships between Caseworkers and students remained 
confined to the school setting and to school topics . 
When we asked whether the respondent had ever discussed 
family problems, money problems, or other personal 
problems with the Caseworker, thejrfe were the results:* 



% Atlanta had the best record.. In 1978-79, 42% of 
the respondents said they had discussed any of 
these topics with the Caseworker. This figure 
rose to 62% in 1979-80. 

• In Indianapolis, the comparable figures were 21% 
in 1978-79 and 3% in 1979-80. 

# In New York, the comparable figures were 23% in 

1978- 79 and 9% in 1979-80. 

The responses to a parallel question about four 
bchool topics (school work, attendance, teacher problems, 
dropping out) resulted in large majorities that reported 
discussing at least one, and often more of those topics. 
The percentages reporting at least one were: 

• In Atlanta, 71% in 1978-79 and 81% in 1979-80. 

# In Indianapolis, 73% in 1978-79 and 63% in 

1979- 80. 

» In New York, 82% in 1978-79 and 64% in 1979-80 



*The Smith and Julia Richman sample sizes for the spring 
interview data in 1979-80 are extremely small (fewer than 
20 in both the Caseworker and student samples} because of 
attrition (see Chapter III and Appendix A), an- the 
percentages should be interpreted vith that in mind. But 
the information from students, Caseworkers, and the 
archives (for which sample sizes v;ere adequate) was - 
consistent on virtually all topics. This convergence 
across data sources gives some confidence that the sample 
size for any one source does not. In any event, 
interpretations are based on orders rf magnitude rather 
than specific estimates of percentages. 
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These figures are probably understatements. Reasons 
that a student might fail to respond "yes" to the items 
include bad memory, impatience to finish the interview, 
or lack of understanding of the question. But the basic 
finding that the level of interaction on these subjects 
was lower than the program intended is supported by the 
Caseworkers — whose answers should logically tend to be 
overstatements (to make themselves look good) if not on 
the mark. The Caseworkers d*d not portray a situation 
that was out of line with the one given by the students. 
For example, the percentages of cases in which Case- 
workers reported that they had discussed at least one of 
the out-of-school topics were 42% in Atlanta, 15% in 
Indianapolis, and 60% in New York for the 1979-80 spring 
survey.* Even when restricted to school topics, the 
answer of "none" occurred for 11% of the cases in 
Atlanta, 15% in Indianapolis, and 20% in New York. 

The same pattern prevails when we focus on the 
extent to which Caseworkers reported that they were 
familiar with problems and needs of the students. We 
examine two indicators: home visits by the Caseworkers, 
and the Caseworkers' self-reports about knowledge of the 
students. 

Number of home visits is one indirect indicator of 
the extent to which Caseworkers explored the student's 
personal situation. The results vary both by year and by 
site. The Smith program particularly emphasized home 
visits, and r they remained frequent throughout both years 
(the mean per student was 15.5 in 1978-79, when a strict 
policy of at least one home visit per month was in force, 
and 5.6 in 1979-80), Visits diminished markedly in both 
Indianapolis (from a mean of 4.6 to 1,9) and New York 
(from 3,4 to .8) from the 1978-79 to the 1979-80 school 
years. 

The more informative indicator is the number of 
times that Caseworkers answered "I don't know" when we 
asked about a student's problems and characteristics. 
Two issues are involved: How quickly did the Caseworkers 
get on top of their caseloads? How well did they get to 
know the members of their Caseloads? 



*The question was asked in a different form (about the 
"last week") in 1978-79, and comparable data are not 
available for that year. The results from the 
alternative form are presented in Report No, 2, p. 8*?. 



For the first of these issues, we turn to the 
interviews conducted in the fall of 1978, four to eight 
weeks after the students had be^n assigned to caseloads. 

The first set of questions involved the behavior of 
the student at school: 

"Does this student need help with any 
school subjects?" 

"At what level is this student reading 
right now?" 

"How well does this student interact with 
other kids?" 

...and similar items asking the Caseworker to discuss the 
student's motivation, self-confidence, and other charac- 
teristics. For these questions, the "don't know" 
responses were extremely small (zero to less than 5% of 
the total). We cannot be sure that the Caseworkers 1 
responses were accurate, but at least they expressed an 
assessment . 

The next set of knowledge items involved the 
student's situation outside the school. The Caseworker 
was asked, 

"How about problems that are not school- 
related. Do you know about any?" 

...and was shown a list of categoriesr "not known, " "no 
other problems," "drug use," "alcohol use," "emotional 
problems," "family problems," "delinquency," "financial," 
and "other." The percentages of students for whom the 
Caseworker responded "not known" in the fall interviews 
were 68% in Atlanta, 58% in Indianapolis, and 61% in New 
York. These self-reported percentages are high, given 
the emphasis that the program placed on determining the 
students' needs quickly. 

A third type of knowledge question asked about the 
student's family: 

"From what you know about the family so 
far, are there any needs that remain 
unmet?" 
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The categories were: "Don't know," "no," "medical or 
dental care," "child care," "alcoholism, H "drug addic- 
tion," "emotional problem," "housing," "income assis- 
tance," "employment," and "other." Again, the "don't 
know" responses were very high during the fall inter- 
views: 81% in Atlanta, 68% in Indianapolis, and 75% in 
New York. Overall, the Caseworkers were slow in estab- 
lishing detailed knowledge about the student's situation 
away from the school. 

Now we turn to the question of whether the Case- 
workers later developed a detailed level of information 
about the students, using the interview material obtained 
at the end of the school year. By that time, when the 
Caseworker had typically known the student for about 
seven months, the "don't know" responses had diminished. 
But they were still bdbstantial, given the premium that 
CIS put on the "personal ism" of the Caseworker/student 
relationship. The "don't know" responses for the item 
about the students' out-of-school problems during the 
spring administration of the interview constituted 18% of 
the responses in Atlanta, 29% in Indianapolis, and 23% in 
New York. The; "don't knows" for the item about the needs 
of the student's family were zero in Atlanta — possibly 
a function of its strenuous home visit policy — 27% in 
Indianapolis, and 17% in New York. 

We have been using isolated indicators. When we 
read the entire case file, including the narrative 
interviews with Caseworkers, the numbers appear to be 
generally representative. Sometimes students had been 
arrested and appeared in court without the Caseworker 
knowing about it. Sometimes the student would tell of 
specific family problems (e.g., an invalid mother) of 
which the Caseworker was unaware. We, cannot quantify 
these into a confident measure of "Caseworker knowledge 
of the student." But the simplest indicator — Case- 
workers stating explicitly that they did not know about 
certain important items — gives a rough sense of the 
magnitude of the problem. The proportions of "don't 
knows" about out-of-school needs (running around 20% in 
most instances) are not out of line with the other 
indications about Caseworker performance.* 

We should emphasize two points before leaving this 
topic. First, we have been assessing CIS against its own 

*See Report No . 2, Chapter 4, 
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standards. When the Caseworkers' level of knowledge 
about the student is compared to the teachers 1 level of 
knowledge, thfe contrast is dramatic. The teachers we 
interviewed as part of the "intensive" c$se histories 
typically knew nothing about the student's out-of-school 
situation. Often, they were ignorant even of the 
student's school performance apart from their" own 
classes. Second, the discussion has emphasized the 
proportions of Caseworkers who apparently maintained 
relatively superficial relationships with their students. 
We have not discussed the sizable proportion Caseworker/ 
student relationships that were extremely close, and in 
which the Caseworker had a highly detailed, perceptive 
understanding of the student*s personal and family 
situation. These are part of the analysis of CIS's 
potential, in Chapter IV. 



v The Caseworkers will monitor attendance and school 
performance, and provide remedial help as needed . 

"These counselors monitor their students' 
schoolwork. They provide remedial educa- 
tion and lots of encouragement .... If one of 
their students skips class, they find out 
why and try to do something about it." 1 

This expectation has been met with regard to monitor- 
ing of schoolwork and followup on absences . Accomplish- 
ments in remedial education have varied wTdely across 
sites and across years , from intensive efforts to fr£q- 
mentary ones. 

The level of effort was extensive, and this was most 
true of efforts to keep the students in school. Although 
there was variance across and within sites, Caseworkers 
generally took an active role in monitoring attendance 
and school performance, and in trying to get the student 
to school when absences occurred. CIS instituted close 
checks on these aspects of Caseworker performance, and 
they appear to have had an effect. 

Caseworkers were actively involved also as advocates 
and mediators for the students who encountered disciplin- 
ary problems and the Caseworker knew about it. According 
to the students, Caseworkers were seldom involved in 
minor disciplinary encounters. They were much more 
likely to be involved for major problems involving sus- 



pension. Of the suspensions that the students admitted 
to, the Caseworker was involved in some fashion in 70% o 
the cases (aggregating over both of the school years). 
Atlanta showed by far the most consistent and active 
record: the Caseworker was present at the hearing in 11 
of the 17 instances that were reported by Atlanta - 
students, and had at least discussed the issue with the 
student in 3 of the remaining ST*" 



The level of effort in tutoring and other directly 
educational functions was inconsistent. All of the sites 
had some form of "orientation" class for all of the CIS 
participants, emphasizing life-coping skills (e.g. , how 
to apply for a job, how to manage a budget, how to plan 
for a career). The details of the curriculum, the number 
of years that it continued, and the attention given to 
the curriculum varied widely among sites.** Reading labs 
are available at all of th£ sites; again, the degree of 
CIS control over materials and staffing varied. And all 
of the sites offered tutoring services. 

In addition, some of the CIS students attended 
classes taught by teachers specifically chosen for CIS. 
This varied by school, and by year. r The importance of 
being a "CIS teacher" also varied. In some sites, in 
some years, the CIS teactffers consisted of volunteers who 
were, by the consensus of observers, highly motivated to 
work with disadvantaged or "problem" students. In some 
sites, in some years, teachers were assigned to CIS with 
very little choice; and neither CIS nor any other sources 
of evidence argued that these teachers were generally 
better than the average in the school. 

Individual tutoring occurred on a case-by-case 
basis, decided by a combination of the student's need, 
the student's willingness to participate, and the 
Caseworker's determination. Group tuftoring also 
occurred, at regularly scheduled time^ and places. 

According to the interview data, tutoring involved 
roughly half of the students during 1978-79, then 

"Note that the number of suspensions reported by 
students understated the real incidence, estimated from 
school records. 

**See Report No. 2, pp. 57-60, for a more detailed 
description . 
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diminished markedly during 1979-80. In 1978-79, the more 
active year/ Caseworkers indicated that fewer than half 
(48%) of the CIS participants received any regular 
tutoring at all. Only 17% of the students were .receiving 
tutoring as often as three days a week. In the 1979-80 
responses, Caseworkers indicated that only 23% of the 
students received regular tuto* mg, and only 9% received 
tutoring as often as three times a week. The differences 
among the three sites were minor — the same trends 
prevailed in all of them. 



The* Caseworkers will provide enrichment activities for 
the students . 

"[The Caseworkers] plan sports activities 
and field trips. m 

This expectation (which encompassed much more than 
sports and field trips) was generously met in all of the 
sites during the first two years of observation . Tn "~ 
1979-80, the levels of student participation fell 
itioderately in Indianapolis. In New York, participation 
in such activities fell to very low levels/ at least for 
the students who remained in the program for a second 
year. 

One of the major activities of CIS was an attempt to 
expose the students to experiences they would not 
ordinarily have (e.g., taking CIS students to a play, or 
on a camping trip) and to engage them in out-of-school 
group activities as a general mechanism for enriching 
their experiences. The activities also acted as incen- 
tives to stay in the program. 

The variety was wide, as a sampling of the activi- 
ties indicates — visits to art galleries, tickets to the 
Ice Capades, a camping trip to North Carolina (from 
Atlanta), preparing a collection of the students' art, 
photography, and poetry, organized sports teams, attend- 
ing a touring Broadway show, a group trip to New York, 
tours of Cit/ Hall, tours of local industrial plants, 
watching a xocal production of Carmen , skating and 
bowling parties, a visit to the Dance Theatre of Harlem, 
a tennis clinic by Arthur Ashe. 



For 
categori 
events) , 
amusemen 
concerts 
events ( 
staff), 
engaged 
1979-80. 



summary purposes, we may group these into four 
es: particpant events (sports teams, reacreational 

general entertainment (movies, sports events, 
t parks), "enrichment" entertainment (plays, 
, museums, visits to other cities), and social 
dinners or other social gatherings with CIS 

Table 3.4 shows the percentages of students who 
in at least one such activity during 1978-79 and 



TABLE 3.4 

Students Reporting Participation in "At Least One" Programmatic Activity 



Smith 



Arsenal Tech 



Julia Rich man 



Activity 


1978-79 
(n = 24J 


1979-80 
(ft * 1*J 


1978-79 
(it * 102» 


1979-80 
(n = 35) 


1978-79 
(n-34) 


1979-80 
In -11) 


Participatory 


0% 


81% 


27% 


46% 


0% 


9% 


Entertainment 


8% 


81% 


24% 


34% 


21% 


18% 


Enrichment 


25% 


94% 


47% 


26% 


35% 


0% 


Social 


21% 


38% 


48% 


34% 


3% 


9% 



# Percentages sum to more than 100 because of multiple activities among some students, 



The proportions of students who partic 
1978-79 were high at all three sites, 
the level of participation in 1979-80. 
the shortened school year and loss of 
reflected in lowered activity levels, 
there appears to have been a generally 
activity, but the second-year students 
our sample in 1979-80) were especially 



ipat6d during 
Atlanta increased 
In Indianapolis , 

staff^gain were 
At Julia Richman, 
lower level of 
(who constituted 
inactive. 



We are unable to attach specific outcomes to this 
participation, except the positive reactions of the 
students that they enjoyed them. It seems reasonable to 



assume, however, that these activities, like a close 
relationship with 'a Caseworker, were goods in themselves. 
For { an adolescent from Harlem who had never left the city 
to igo for a camping trip in the. mountains; for a young- 
ster from inner-city Atlanta to see a professional dance 
company: these kinds of experiences can hardly have been 
negative, and they were probably landmark events in some 
instances • 



The ; Caseworkers will orchestrate the delivery of social 
services as needed . 

"[The Caseworker] puts them in touch with 
job possibilities, financial and legal aid, 
health care and housing, and if necessary, 
drug rehabilitation. .. .What [the Case- 
workers] have to give are the resources of 
existing federal, state,, and local social 

service programs — delivered in a personal 
way $ 

This topic has been a source of continuing contro- 
versy between the program and the evaluation. Therefore, 
we incorporate CIS*s reading of the situation in Appendix 
B. 

From one perspective, the counseling function 
represented a major social service in itself. We have 
already discussed the topics of the interactions between 
Caseworkers and the students. Insofar as those interac- 
tions usually involved some sort of discussion, advice, 
or other counseling content, and insofar as they spanned 
a variety of concerns — school performance, family 
* problems, emotional problems^ etc. — "integration* of 
that service was taking place. 

The program was also especially active in helping 
students to find and keep jobs.* Student self-reports in 

*One of the most successful of these programs (in 
Atlanta) occurred after the observation period for the 
evaluation had officially ended. Using a combination of 
CETA slots and corporate support, a hiqh proportion of . 
interested students were placed and successfully 
maintained in summer jobs. 
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the spring interOdews for 1979 and 1980 revealed that, by 
May, x 



# At Smith, 16 of the 23 respondents had 
applied (or been accepted) for summer 
jobs; of those, 11 had been helped by 
CIS, 

# At Tech, the comparable figures were: 82 
put of 99 were applying, of whom 71 
acknowledged CIS help, 

# At Julia Richman, 31 out of 34 were 
applying, and 30 acknowledged CIS help. 



CIS also conducted active screening programs: 
medical examinations for CIS students and surveys to 
determine eligibility for Title XX assistance were the 
two most common types. Other efforts were made to esta- 
blish whether families were obtaining all the benefits to 
which they were entitled from programs such as AFDC and 
Food Stamps. 

When the subject is limited to actual delivery of 
social services of the type mentioned in the CIS brochure, 
the level of accomplishment appears to be low. Based on 
all of the evidence that we have been able to assemble 
from interviews and from the archival materials, our fin- 
ding is that delivery of social services as traditonally 
defined (e.g., housing, welfare assistance, professional 
counseling, legal advice, medical assistance) was a small 
part of the CIS operation. We will summarize the basis 
for this finding in terms of three types of evidence: the 
structured interviews with Caseworkers, the archival logs 
maintained by CIS Caseworkers, and the results of the 
intensive, open-ended interviews. 

Interviews with Caseworkers . The data in Report 
No* 2 indicated that the incidence of noneducational 
service delivery was extremely low (pp. 107-110). The 
data from the 197f /9 and 1979-80 school years were 
consistent with those results, despite the efforts of CIS 
to upgrade the identification of needs and the delivery 
of services . 

For student needs, the relevant item in the inter- 
view asked whether the student had problems that v/ere not 
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academically-related. The response categories were: drug 
use, alcohol use, emotional problems, family problems, 
delinquency, financial problems, or "other. " We then 
asked the Caseworker to describe how these problems were 
handled. 

The results from bo£h years and across cities were t 
consistent. On three categories — emotional problems, \ 
family relations, and financial problems — the percen- 
tages of students who received help were substantial 
(Emotional problems: 17% in 1978-79, 21% in 1979-80. 
Family relations: 28% and 27%. Financial problems: 30% 
and 26%). The percentages of students who received help 
on the other categories (delinquency, drugs, alcohol) 
ranged from 2% to 8% in both years. 

The meaning of "receiving £elp" admits of consi- 
derable ambiguity. The percentages of students who were 
referred to service delivery resources was very small 
when computed over the whole sample of students (from 1% 
for alcohol problems, in 1978-79, to a high of 8% for 
family relations problems, also in 1978-79). In the rest 
of the cases, "receiving help" consisted of counseling by 
the Caseworker. 

At another point in the interview, we asked whether 
the Caseworker had "been involved in trying to arrange 
assistance" with regard to medical or dental care, child 
care, mental health (including probems of alcoholism or 
drug addiction), housing, income assistance, employment, 
or any other family need. The wording was deliberately 
inclusive, so that we would capture the full janqe of CIS 
efforts, minor or major, successful or unsuccessful, in 
this domain. Despite the inclusiveness of the question, 
the "yes" responses were few. In 1978-79, Caseworkers 
reported that they had been "involved" in 1^% of the 
students 1 families. In 1979-80, the proportion rose 
slightly to 17%. When we examined the details of what 
being "involved" meant, the numbers dwindled further. 
For example, the percentages just given include instances 
such as, "Talked to the store manager where (the student] 
had been laid off. Haven't heard anything since" — 
apparently an instance of an unsuccessful attempt to 
help. They include instances such as "Encouraged mother 
to apply for Food Stamps — don't know if she ever did," 
where both the extent of the Caseworker's effort and its 
outcome are in doubt. The more concrete examples, such 
as "Took student to see the doctor" accounted for fewer 
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than half of the instances when the Caseworker said that 
he had been involved in arranging help. 

» 

These data can be interpreted in several ways, 
depending on one's estimates of the ability of the Case- 
workers, whether the data reflect ignorance of problems 
or real incidence, and the proportions of students that 
constitute a "large" or "small" number. But we may avoid 
these ambiguities by staying for the moment with the most 
basic issue: For whatever reason, CIS Caseworkers did not 
report large-scale orchestration of service delivery to 
meet family-specific needs. On the contrary, their 
responses taken at face value suggest that such services 
were provided (or were needed) only sporadically. 

The Archives. m 1977-78 and 1978-79, we examined 
the program s case files, attempting to reconstruct the 
inventory of services and interactions. These efforts 
proved to be of no analytic use, except to point to 
problems in record-keeping. A few of the Caseworkers 
kept excellent records; most did not. In the summer of 
.1980, however, the Director of the Smith program asked 
that we reexamine our coding from the 1978-79 school year 
and add data from the 1979-80 school year. The Smith 
program had made a major effort to maintain accurate, - 
complete logs, and he felt (and we agreed) that these 
data should be reflected in the evaluation. Therefore, 
we reconstructed the archival record for 39 students: 18 
who were nominated by the Smith staff as their best 
examples of success, and another 21 randomly selected 
from among the remaining members of our original 1978-79 
interview sample.* 

For certain types of CIS services, we caraiot expect 
that the logs reflected the complete record. Caseworkers 
were routinely supposed to check on the eligibility of 
families for Title XX and for other types of 
entitlements. We assume that some of these checks were 
not entered in the log, especially when no further action 
was indicated. In adJ^fion, the program provided free 
physical examinations for all students. Sometimes Case- 
workers took their own caseloads to the examination, and 
that was noted in the log. In instances when a Case- 



The number of cases in this effort was determined by 
the amount of time we had available at that late point in 
the evaluation (the data collection was supposed to have 
ended ) . f 
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worker, took several students at one time, or students 
from another caseload, we assumg that not all of the 
physical examinations were noted in alfof the appro- 
priate case files. 

* 

With those qualifications, the instances of attempts 
(successful and unsuccessful), to respond to specific 
service heeds were as follows: 

Help in applying for a job 19 

Medical (other than physical exam) 10 

Housing advice or assistance 4 

Emergency supplies (e.g., food) 4 

General transportation help , 3 

Advocacy, with the juvenile court 3 

* c Other legal assistance 1 

Help in applying for welfare benefits 1 
TOTAL 45 

Note that the total, of 45 represents humber of citations 
either in the log or in associated documentation, not 
numbers of students. In 15 of the 39 cases — 38% — 
"social services" as* that word is traditionally defined 
were not provided. Further, many of^the items in the 
list involved marginal services t- "general transpor- 
tation assistance" meant that the Caseworker drove the 
student someplace. "Advocacy with the juvenile court" 
was counted even if the*loq reported only that the Case* 
worker attended a court hearing. 

The most impressive aspect of service delivery was 
employment assistance, consistent with the experience at 
the other two sites. 



The Qualitative Record . The set of "intensive" 
cases, in which the Caseworker, student, and parents were 
interviewed using open-ended items, reveal a story that 
is -consistent with those of the structured items and the 
archives: There were indeed isolated instances in which 
Caseworkers were instrumental in obtaining assistance in 
housing, emergency food allotments, or other services. 
But we continue to deal with very small numbers. More to 
the point, the instances in which the Caseworker did 
arrange for help are outnumbered by accounts of problems 
that the Caseworker had identified, but did nothing (or 
was powerless to do anything). 



The patterns follow those observed earlier in CIS f s 
history (see Report No, 2 , pp. 110-122). Rather than add 
to that record here,, we will incorporate material about 
the characteristics of effective and ineffective Case- 
worker behavior in the analysis in Chapter IV. 

v. 

Summary . The picture we have given of CIS's accom- 
plishments in providing services is not consistent with 
the information that CIS collects on the same subject, 
we are most conspicuously at odds on the issue of social 
service delivery. CIS f s Management Information System 
(MIS ) reports student contacts, family contacts, student 
services, and family services i"or 22 categories of 
services.* Strict definitions of "contact" and "service" 
are used, requiring that the event involve concrete needs 
and actions. We have po evidence that the numbers in the 
MIS are deliberately inflated. ^On the contrary, we have 
observed repeated efforts by CIS to upgrade the accuracy 
of the system. 

Why is there a discrepancy? The answer seems to lie 
in some wide differences between AIR evaluations and CIS 
Caseworkers about what constitutes evidence of a service. 
Tftis is best illustrated by the results when AIR and CIS* 
used the identical data base (in Atlanta) to count ser-^ 
vices • 

When the Director of the Smith -program requested 
that we reexamine the case files, he did so because, from 
his perspective, those? files contained evidence of inten- 
sive and extensive service delivery. The files were 
indeed fat, sometimes running to more than a hundred 
entries. Yet, when we had finished with ttfem, we emerged 
with the skimpy list shown earlier. The rest of the 
material fell into the categories of educational ser- 
vices, general counseling, and enrichment activities. 

After these results were given to CIS in October, 
staff at .Smith took 12 of the 39 names and duplicated our 



*The categories are: employment, dental, medical, 
glasses, drug/alcohol counseling or treatment, APDC, food 
stamps, Title XX, Medicaid, other public assistance, ' 
counseling for family problems, peer problems, school 
problems, and personal problems, staff counseling for the 
family, professional counseling, housing, clothing, 
legal/criminal -justice, daycare, transportation, " and 
"other." 
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search. The results they found for the same categories 
were vastly different from AIR's. Where we had found 10 
instances of medical assistance for all 39 cases, they 
found *.7 for just the subsample of 12. Where we had 
found 19 instances of help in applying for a job, they , 
found 29 instances (again, for just the subsample of 12} 
in the category of "career development and job placement 
efforts." And so on, through all the categories. 

There was no time for the obvious next step: to 
compare notes on those 12.* We do know that AIR's numbers 
were obtained through an extremely detailed examination 
of the files. Instructions were explicit that every 
possible instance be noted. The data collectors indepen- 
dently reviewed identical files on a spot-check basis. 
Two data collectors always worked together, so that 
marginal items could be discussed. Direct quotations 
were taken from the files for later review when there was 
ambiguity. In short: we believe our numbers to be accu- 
rate. Further, they were inclusive. 

In compiling the list of 45 item^., a loose defi- 
nition of "service" was used. For example, we did count 
an entry that read, 

"Told John that there is a job opening at 
MacDonalds and encouraged him to take it," 

even though it is not at all clear that a real 
service had been provided. But we did not count 
entries such as 

"Asked John whether he had submitted the 
job application* He said no." 

"John told me that he had decided not to 
apply for the job." 

"Talked with John about summer jobs, and 
told him I would be glad to help him with 
applications if he wanted me to." 

One plausible explanation for the discrepancy between our 
figures and those of the MIS is that analogs of the last 
three examples are showing up as "services provided." 

*The results about the 12 were received five days before 
the final report was due* 
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For that matter, should we have counted them too? 
Our judgment is "no." CIS is described appropriately as 
providing for extensive interaction between students and 
Caseworkers. A legitimate distinction may be drawn 
between general interactions, whether about jobs or 
school or personal problems', and specific services. The 
story from the Caseworker interviews, from the student 
interviews, from the open-ended "intensive" cases, and 
from the logbooks all consistently indicate that the 
incidence of the latter type of service delivery was low. 



ASSERTION NO. 2 

"The higher quality of service leads to significant, positive imnact 
on the youth/' 

It is obvious that the purpose of CIS is to help the 
students who participate. It is less obvious precisely 
how that help should manifest itself in short-term, 
observable results. There are some candidate measures 
that quickly come to mind — higher attendance, better 
grades, better behavior in school. But these do not get 
at the ultimate purposes of the program. CIS was not 
developed because inner-city high schools have attendance 
and achievement and discipline problems. It was started 
because of the longer-range debilities. Given everything 
known about the type of school population with which CIS 
works, it must be expected that most of the students who 
have the worst academic and behavioral problems while CIS 
works with them will become adults with worse problems 
yet — perhaps unemployed, on drugs, in jail, and, 
whatever the specific outcome, wasted. As its ultimate 
objective, CIS seeks to forestall this future for at 
least some of its students. 

To do so, CIS does not have the option of a single, 
dramatic "treatment" that makes the problems go away. 
Rather, it can only set in motion a sequence of events 
whereby the program engaqes the students interest and 
cooperation, induces internal changes in attitude and 
motivation, and finally (it is hoped) observes the fruits 
of those internal changes in the form of changes in 
behavior. We stress the notion of a sequence of out- 
comes. It has *-*o implications for the impact analysis. 

First, the sequential nature of the outcomes shapes 
the interpretation of cause anc 1 effect in assessing ClS'r 
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role. Failure to achieve the early outcomes casts doubts 
on CIS's role if changes in the later outcomes are 
observed. Conversely , failure to achieve the later out- 
comes does not necessarily mean that the program is a 
failure. We discuss this issue at greater length in 
Chapter IV, but the main point is a simple one: CIS is 
not intended to be a panacea, but a contributing factor 
to improvement. Certain outcomes are almost entirely 
within its control, and CIS can be held accountable for 
them. Others depend on a variety of other circumstances. 
Failure to achieve them may have more important 
implications for other aspects of the "surround" — the 
rest of the factors — than for CIS. 

Second, developing an explicit view of the sequence 
enables us to put the achievements of the program in 
context. What does it mean, for example, that a student 
attends school more often because of CIS? This is not a 
good in itself; it is good because it facilitates certain 
other outcomes. Specifying the outcomes to which it 
contributes and specifying the earlier outcomes that 
r ist have fed into the student's decision to attend 

school more often — provide a framework for interpre- 
tation. 

To organize the indicators, we divided the sequence 
of outcomes into four stages: CIS services , 
preinvestment outcomes , investment behaviors , and 
achievement . Figure 3.1 on the following page depicts 
the overall map of outcomes that we have used. The map 
(or "program rationale," in AIR's terminology) moves from 
left to right, starting with the Caseworker's inputs and 
moving through the preinvestment outcomes, then the 
investment behaviors, to the achievement measures. 

The definition of each stage, and the logic behind 
the specific outcomes listed under each, are described 
fully in Report No. 3 . (pp. l'jH-26). Briefly, the argu- 
ment is th i s : 

• CIS tried to achieve its impact on the 
students through four mechanisms: by 
directly influencing behavior through the 
Caseworker's advice, example and autho- 
rity; by affecting the student's values, 
norms, and motivations; by reducing the 
student's learning deficits; and by 
reducing the economic and social impedi- 
ments to achievement. 



FIGURE 3.1 
Rational for Impact Indicator! 
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# If sucqgfesfur, these efforts by CIS will 
cause some early , internal outcomes. The 
student „wi 11 have a better idea of what 
his options are, and what must be done to 
take advantage of them. He will have an 
increased sense of ability to control his 
future. And he will adopt stricter 
standards of personal behavior. 

• To the extent that these internal changes 
have taken place, some behavioral changes 
should also occur. These are labeled 

" investment* behaviors to indicate that 
they represent attempts to achieve — 
investments of time and energy — rather 
than successful attempts to achieve. 
Examples of investment are increased 
resistance to negative peer pressure, 
increased effort to get to school, in- 
creased voluntary learning (in the form 
of electives, for example), and increased 
attention and effort in the classroom. 

* If enough investment occurs, some evi- 
dence of success should eventually fol- 
low: reduced absences, increased class- 
room success, reduced destructive beha- 
vior, and increased success in inter- 
personal relations. 

• Finally, these successes should be 
reflected in the official measures: 
reduced arrests, reduced dropouts, higher 
grades, higher test scores. 

It is within this framework that we have examined 
the results of CIS. What have we found? 
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Impact Results: 1978-79 



After testing the performance of CIS in 1978-75 
against these indicators, Report No. 3 found that, 
combining results across sites, CIS could not point to 
evidence of consistent success, even in achieving the 
earlier outcomes. For individual sites, however, some 
clear distinctions could be drawn. Smith and Julia 
Richman did not show a pattern of progress. The Tech 
program did. To summarize the results in Report No. 3, 
we developed a simple tally, duplicated in table 3.5 — 
below. In the Table, we display the direction of the 
results for each major cluster of indicators, using a 
three-point scale, assigning when results were posi- 
tive, "0" when they were mixed, and when they were 
negative. 

The difference between Tech and the other two sites 
was striking. To account for it, we noted differences in 
program continuity (the Tech staff had been stable at the 
senior levels for three years), the student populations 
(Tech had an "easier* population to work with), the 
external factors (Tech had an "easier" urban context to 
work within). But the most provocative difference 

t* -. the other two cities, from an evaluation 

standpoint, was that Tech had much the better record in 
successfully operat ionalizing the structure and the 
rhetoric on which CIS was based. Our basic conclusion: 
The more closely CIS program operations and staff resem- 
ble the CIS model, the better the results. And we inter- 
preted this as beiYig a positive sign in evaluating CIS, 
the concept. 



Impact During the 1979-80 School Year 

We have very little new information to add to the 
1978-79 analysis. Two events contaminated the analysis 
to such an extent that, to put it bluntly, the impact 
data from 1979-80 are uninterpretable. 

First, the Tech program that produced the positive 
results abruptly ceased to exist durinc 1979-80. Because 
of the school strike in Indianapolis, school did not 
start until late October. Two out of the 9 months of the 
"treatment" were eliminated. Further, the "nontreatment 
period" was lengthened from three months to five months, 
with unknown but presumably definite consequences on stu- 
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TABLE 3.5 f 

1978-79 Direction of Results in Achieving Outcomes 



OUTCOME 


Smith 


(NA: Not Available) 


Julia Rich man 


1 Increased understanding of options 




+ 


NA 


2 Increased <4Pn^p of mntrni nuor 
the future 


NA 


+ 


* 

+ 


3, Stricter standards of personal 
behavior 




+ 


- 


\4. Increased voluntary Learning 




0 


+ 


o Increased attpntmn and pffnrt 
m the classroom* 


- 


0 


— 


6. Reduced voluntary absences, cuts 


- 


0 





7. Increased success in interpersonal 
relations 


0 


+ 





8. Increased success in learning 
situations 


+ 


+ 


0 


9- Acquisition of bas?c reading skills 


+ 


+ 


NA 


1 0. Reduced off ic ial del inquency 


+ 


0 


NA 


1 1 . Higher attendance 




+ 


0 


1 2. Higher grades 


0 


0 


0 



NOTE Sample sizes varied by indicator, as specified in Report No 3. 



dent momentum, motivation, and attitude toward school in 
general. The reduction in the school year was compounded 
by a major shortage in Caseworker staff. Funding delays 
meant that the program was was around 20 to 30 percent 
short of its planned Caseworker staff throughout the 
year. But the number of students assigned to caseloads 
remained at the planned level. Caseload size was 
increased. Continuity in Caseworker/student pairings was 
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low. Taken together, the strike and funding problems 
drastically altered the nature of the Tech program. 

This leaves us with the two other sites, Smith and 
Julia Richman, which did not show demonstrable effects on 
the impact indicators shown in Figure 3.1 during the 
1978-79 school year. Did they improve their performance 
in 1979-80? In trying to answer that question, we run up 
against the second contaminant: a very high attrition 
rate in the sample. The data are shown ^in Table 3.6 
below. 



TABLE 3.6 

Attrition in the 1978-79 CIS Population 



Original Sample Size* 


Smith 
74 


She 
Arsenal Tech 
259 


Julie Rich nun 
154 


Left school before graduation 


22 (30%) 


36 (14%) 


39 (25%) 


Transferred to another school 
or graduated 


f 

6 (8%) 


13(5%) 


31 (20%) 


No information 


8 (11%) 


61 (24%) 


0( -) 


Still in school as of 5/80 


38 (51%) 


149 (58%) 


84 (55%) 



* For Smith and Julia Richman, the population of all students still on the roles as of 
1 October 1978 was used For Arsenal Tech, a random sample was selected. 



As the table indicates, only about half of the stu- 
dents who were in the program in September of 1978 were 
still in the program as of the end of the 1979-80 school 
year: 51% in Smith, 58% at Tech, and 55% at Julia 
Richman, 

Most of these disappearing students left the school 
system before graduating. That is, they were dropouts, 
or left school for some other negative reason (e.g., 
incarceration). Of all those who left the sample for 
reasons that we could determine, 79% fit this category at 



Smith and 73% at Tech. The rest of the disappearing 
students on whom we had information had transferred to 
another school, been mainstreamed into the regular school 
program, or had graduated. 

This still leaves open the question of ClS's true 
dropout rate because, as Table 3.6 indicates, we could 
not obtain definite information on the whereabouts of 
some of the disappearing students. Among the "no infor- 
mation* students, the most plausible assumption is that 
most had left the school system; but we cannot determine 
the precise number.* 

Attrition through dropout is a negative indicator in 
itself. One of the purposes of the program was to keep 
students in school, and in a large proportion of cases it 
failed to do so. Preventing dropout is, however, one of 
the tougher, longer range outcomes, and it depends on 
many factors beyond CIS's control. The dropout rate has 
a decisive effect on how well we can measure the pro- 
gram's effectiveness (as we will discuss shortly), but 
it is not decisive evidence that the program itself was a 
failure. 

We have no satisfactory way of determining bow many 
of these students would have dropped out if the urogram 
had not existed. CIS in all three sites dealt with sub- 
populations that were believed to be the most likely to 
fail. Further, the estimates of dropout rates from 
school data yield results far different from those that 
employ material from CIS as well. That is, the school • 
records tend to show either "no information" or "tran- 
sferred to another school system" when the real reason 
was dropout. Conversely, they sometimes show "dropout" 
when in fact the student had returned to school. Thus, 
(a) the official rates of dropout in all three schools 
are lower than from CIS, but (b) these figures are 
measured using incomparable data and an incomparable 
population. 

We may, however, examine the records of groups in 
those schools who also had attendance problems, but were 
not in CIS. In Atlanta, the comparison group consists of 
non-CIS students who entered Smith as ninth-graders in 
fall 1978, and who missed at least 10 days of school 



*Even the category of "transferred to another school" is 
suspect, especially for the younger students who could 
not legally leave the school system. 



during the 1978-79 school year.* In Indianapolis, we use 
a comparison group that originally was randomly chosen 
from among all students who met the program's entrance 
criteria.** In New York, the comparison group consists of 
non-CIS ninth graders who entered Julia Richman as 
ninth-graders in 1978-79 and were not assigned to any * 
other special program (e.g., for gifted students). In 
all three cases, the comparison of dropout rates asks: 
Among students who stayed in school throughout the ninth 
grade, what percentage left the school's rolls during the 
tenth grade? The results are shown in Table 3.7. 



TABLE 3.7 



Attrition in the 10th Grade: CIS Compared with Non-CIS Students 






Non-CIS 






CIS 






Mean Days 

Absent 
9th Grade 


% Leaving 
School Bolts 

During 
10th Grade 


(n) 


Mean Days 

Absent 
9th Grade 


% Leaving 
School Rolls 

During 
10th Grade 


(n) 


Smith 


41.7 


29% 


(42) 


44.0 


34% 


59 


Arsenal Tech 


27 4 


20% 


(122) 


211 


34% 


104 


Julia Richman 


47.G 


33% 


(102) 


44.5 


30% 


106 



CIS sample all students who participated in CIS through the end of the 9th grade. 

Non-CIS samples: Smith: students absent at least 1 0 days in 9th grade. 

Arsenal Tech: comparison group (see Appendix A), 

Julia Richman: all 9th graders not participating in another special program. 



*Ten days was the lower limit that produced a subgroup 
with a mean absence rate closest to that of CIS 
ninth-graders. 

**Despite subsequent contamination, the Tech comparison 
group is by far the best of the three in terms of its 
statistical comparability. 
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At all three sites, the ninth grade attendance pat- 
terns were similar for the CIS and non-CIS group.* The 
proportion of the ninth grade "survivors* who then 
dropped from the rolls during tenth grade was nearly the 
same for CIS and non-CIS alike at both Smith and Julia 
Richman. At Tech, the numbers favor the comparison 
group: only 20% of the comparison group left the rolls 
during the tenth grade, compared to 34% of the CIS group. 

Explanations of the results from Tech must be specu- 
lative. Given the relative "comparability 11 of the Tech 
comparison group, the large, statistically significant 
difference cannot easily be ascribed to hypothesized 
"other, differences" between the two groups. The expla- 
nation favorable to the program is that the successful 
CIS program in 1978-79 was keeping students in school who 
would otherwise have dropped out during that school year; 
the program loat them when it was truncated in 1979-80. 
The results frdm 1978-79 lend support to that expla- 
nation. Using a comparable measure, CIS lost only 6% of 
its ninth graders, while the comparison group lost 15% 
during that year. Given the admixture of school trans- 
fers and other innocent reasons for leaving the rolls, 
this should remain speculation. 

Our reason for introducing the attrition problem at 
this point in the discussion is not because we think it 
,is intrinsically the most important datum, but because it 
has a pervasive effect on the rest of the impact analysis 
for the 1979-80 school year. Attrition of this magnitude 
creates two insurmountable problems. 

First, the attrition drove the interview sample 
sizes to very low levels by the end of the 1979-80 school 
year.^_Qnly in Indianapolis do we retain a large enough 



*In addition to the similarity between means at each 
sites, the variation was comparable, with the exception 
of Julia Richman. Standard deviation pairs (non-CIS/CIS) 
were; Smith: 28.7/25.6. Tech: 29.3/23.7. Julia 
Richman: 35.0/43, 8 
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Sample to use for more tfhan anecdotal purposes 
Tech program in 1979-80 was truncated.* 
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But sample size is the lesser problem. Even if the 
sample sizes were usable (as in the archival data on 
grades and attendance), we cannot interpret the data, 
because of what we must assume to be a major selection 
artifact. That is, those who stayed in the program were 
different from those who left, and the bias works in 
favor of CIS. This is most simply illustrated in the 
case of attendance. When we report attendance data, we 
are in effect saying: "CIS took a population of students 
with poor attendance records. In assessing CIS's impact 
on attendance, we shall ignore the 50% whose subsequent 
attendance was worst, and present the figures for the 
other 50%.* 

The actual data reveal the problem vividly. First, 
consider the unadorned attendance data for the students 
in our remaining sample at^Jthe Smith High School CIS 
program. They tell us that, t^he year before joining CIS, 
these students had an average c& 50.9 days of absences. 
Durin9 the first year in CIS the average absences dropped 
to 35.9 — a reduction of 29%. During the second year of 
CIS, absences dropped again, to an average of 32.6 days 
— an addi clonal reduction of 9% and an overall reduction 
of 36% from the pre-ClS year. This appears to be a 
highly positive finding. 

But: the only students in our sample are the ones 
who stayed in school through the two years. What about 
the students who left the program? When we compute t;he 
absences of the students who remained in the program for 
one year, but later left the school (and our sample), it 
turns out that the mean absences for this group during 
the first year in CIS was not 44.0 days, but instead 

*The impact analysis examines change scores — the' 
difference from pretest to posttest r*-> the same item. 
Statistically, change scores are much more sensitive to 
small sample size than estimates of the population mean 
at either time separately. Put roughly, interpreting a 
mean value requires only that the estimate be accurate 
within a certain range above or below the true value. 
When a change score is being intrepreted, the same level 
of inaccuracy in both estimates can lead to a 
misinterpretation not only of tjhe size but even of the 
direction of the true change. 
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55.8. The pre-CIS absences for this group was 47.2 days, 
Thus, the net change in attendance among those who later 
disappeared from the sample was not a reduction of absen- 
ces, but an increase of 18%. 

Table 3.8 shows the figures for all three schools. 



TABLE 3.8 

Effects of Attrition: The Case of Attendance 



8th. grade 



No. of toys Absent 
9th gride 



10th 



Remained in sample 
Left sample 
Total 
Total n 



509 
47.2 
50.2 
(29) 



35.9 
55,8 
44.0 
(59) 



32.6 

32.6 
(30) 



Antral Tech 

Remained m sample 

left sample 
Total 
Total ft 



35.7 
44.5 
39.2 
(80) 



19.9 
39.3 
27.7 
(104) 



26,9 

26.9 
(62) 



Julia Rich men 

Remained in sample 

Left sample 
Total 
Total n 



365 
54.9 
43 2 
'77) 



37.2 
55.0 
44.5 
(100) 



53.0 

53.0 
(52) 



Original sample students who joined CIS as 9th graders in September 1978. 



Tech has a somewhat more positive picture than Smith: 
absences decreased among those who later left the sample 
as well as among those who stayed. Julia Richman shows 
negative results for both groups: absences went up among 
those who survived the tenth qrade as well as among those 
who left. 
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CIS has argued an alternative explanation: The 
students that are assigned to CIS are the ones that are 
expected to drop out. To keep such students in school is 
an achievement in itself; to reduce the absences of even 
a minority of them is noteworthy. Is this argument 
consistent with experience? Table 3.9 shows the results 
when the attendance records of the comparison groups are 
put against those of CIS. 



TABLE 3.9 

Absences: CIS Compared with Non-CIS Students 






Non-CIS 


Days Absent 


CIS 






9th Grade 


10th Grade 


in) 


9th Grade 


10th Grade 


in) 


Smith 

Students who completed 10th qrade 

Students who left sc hool rollb during 
IQth grade 


34 8 
61 1 


26 2 


(31) 
(11) 


35.9 
55 8 


32,6 


(39) 
(20) 


Arsenal Tech 

Students who completed 10th qrade 

Students whu let c y hool rolls durmq 
10th '4? tide 


21 9 
48 9 


31 0 


(90) 
(23) 


19.9 
39 3 


26.9 


(68) 
(36) 


Julia Richman 

Students who completed 10th qrdde 

Students who fc-t\ * *«ool rolls dunng 
* 0th grade 


41 1 

60 7 


41 0 


(68) 
(34) 


37.2 
55 0 


53,0 


(69) 
(31) 



CIS sample lii s"«dents wno participated in Cib through the end uf the 9th grade 

Comparison samples: Smith: students absent at least 10 days m 9th grade 
Arsenal Tech: comparison group (ser Appendix A) 

Julia Richman: All 9fh graders not participating in another soenal program 



At Smith and Tech, the comparison groups close]y mimic 
the results of th3 CIS group from the ninth to the tenth 
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grade. At Smith, the students who remained through tenth 
grade reduced their absences by 9%. The non-CIS students 
who had had attendance problems (at least 10 days absent 
in ninth grade) but had survived tenth grade also reduced 
their absences, by 25%, At Tech, the CIS students (who 
had shown a large reduct ion in absences between the 
eighth and ninth grades) increased their absences by 35% 
in the tenth grade • But the compar ison group students 
also increased their absences, by 42% • 

At Julia Richman, the comparison group did not 
resemble CIS. The comparison group students who survived 
the tenth grade held their absences steady at about 41 
days. The CIS students who survived the tenth grade 
showed an increase of absences from 37.2 to 53.0, or an 
increase of 42%. 



We stress the limits of these comparisons. The 
comparison groups show similar ninth grade attendance 
patterns, but in other respects the CIS youth were likely 
to have been a more problem-laden group, especially at 
Smith and Julia Richman. Thus, for example, we would 
dispute an interpretation of the Julia Richman data that 
CIS made things worse. But while the comparison data 
cannot be sod to fine-tune our assessment of effects 
that d id occur, they can be used to make a less ambitious 
tatement: Students with attendance problems in the ninth 
grade behaved about the same in the tenth grade whether 
or not they wore in CIS.* 



The mam point, however, does not have to do with 
attendance but with the maqnitude of the distortions 
introduced into all of the impact measures by the large 
attrition rate. When attrition is relatively small, the 
analysis can compensate for the selection problem* When 
it reaches the proportions that characterized the CIS 
samples, it cannot. The numbers are not interpretable , 
and the same phenomenon apDlios throughout our measures. 
Whether the topic is attitudes, values, classroom 
behavior, peer relationships, or achievement, the stu- 
dents who left the program were predominantly "failures" 
on some or all of those dimensions. The analysis is per- 
force limited to those who were at least "partial suc- 
cesses 1 by the token of having remained in school* 

*It should be noted that the reduct ions in absences 
found at the Tech proc,L-am in 1978-79 could not be 
explained away in the same manner. See Report No , 3, pp. 
68-72. ~ 
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Even ignoring the selection problem, the numbers as ' 
they stand are not generally positive. Grades, for 
example, did not increase even among those who remained 
in school; in fact, they declined slightly over the stu- 
dents 1 first two years in the program. The items covered 
for 1978-79 in Report No, 3 (e.g., on values, difficulty 
m school, locus of control, level of effort) did not 
reveal improvements among the students who remained in 
the program. In short, we are not faced with a body of 
results for 1979-80 that loov good on the surface, but 
are probably spurious. The numbers as they stand do not 
make the case. 

These statements about selection artifacts and about 
the observed results apply to estimated changes acro ss 
the CIS population . It is appropriate to remember wtTat 
we said about such estimates when we first wrote the 
evaluation des ign : 

Large changes in individuals are of primary 
i nter es t; not mean changes among groups . 
Suppose, tor example, that 100 CiS students 
showed a mean increase in attendance from 
2.0 to 2.5 days p^r week. If that change 
consisted entirely of students who had for- 
merly been skipping three days of schol per 
week and after CIS were missing only two- 
-and-one-half , then the change would say 
very little about real impact on the youth, 
regardless of statistical significance. 
But if instead the change consisted of some 
students whose attendance changed drama- 
tically — from one or two days a week to 
full attendance except for legitimate 
absences — then for that subsample of 
students the change in attendance is plau- 
sibly indicative of some fundamental change 
in approach to school and approach to the 
future. The same applies to most of the 
measures. { Evaluation D esign , p. 12. 
Emphasis in the original.) 

Given this situation, the appropriate next step is 
to examine the program's effects on a micro, case-by-case 
level, rather than to rely on statistical associations* 
This is the function of the discussion in Chapter IV. To 
copclude this aspect of the assessment, the summary 
^fatement is that the quantitative analysis of impact 
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revealed no consistent pattern of progress in New York 
and Atlanta for either of the two years 1978-79 and 
1979-80. The analysis did show a consistent pattern of 
positive indicators in Indianapolis for the 1978-79 
school year. This pattern was not repeated in 1979-80. 
The parsimonious explanation is that the 1978-79 program 
was not repeated in the subsequent year, because of the 
teachers* strike and to understaf f ing . 



ASSERTION NO. 3 

"These positive benefits can be achieved without excessive increase 
to costs of present delivery systems. " 



The actual costs that CIS incurred were split among 
multiple sponsors. Some were dollar expenditures; other 
were in-kind. Some were associated with formal agree- 
ments; others were informal donations. Some had precise 
metrics (salaries); others did not (what is the oppor- 
tunity cost associated with vacant office space in the 
school?). Some of the costs were ones that a continuing 
program would have to sustain; some were peculiar to 
CIS's status as a demonstration program. 



The original assertion of CIS looked ahead to a full 
implementation of the concept, which would use the 
existing cadre of service-delivery personnel into the 
schools. The argument was that CIS could be implemented 
without a net increase in people, and hence without major 
incremental costs . 

The possibility remains a live one. Agencies that 
use a caseload approach (e.q., probation departments, 
welfare agencies) could reconfigure the caseloads so that 
staff stationed at the school in combination with staff 
remaining at the central office cover the same total 
workload* For agencies that do not use a caseload 
approach , some fundamental changes in their way of doing 
business would be required. * 

Beyond this limited statement, however, the evalua- 
tion cannot speak to the issue. Although Few York and 
Atlanta did employ a few outstationed regular employees 
of the existing system, nowhere r!id the program have the 
opportunity to test whether it is possible to use out- 
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stationed personnel to cover existing responsibilities.* 

In the following discussion, we present a framework 
for assessing costs of CIS as a cont inuing, year-round 
progra m attached to the public school system * We assume 
a program the size of Smith's: three Families, each with 
four Caseworkers and initial caseloads of 15 students per 
Caseworker. We assume that attrition and replacement* 
will leav£ each Caseworker with a net of "12 
student-years* per caseload per year. 

The purpose of the exercise is not to describe what 
CIS cost in the three sites (though our figures are 
generally consistent with experience) but to permit 
readers to project what a stable program would cost under 
varying local conditions . The cost elements are: 

1. Caseworker salary and benefits 

2. Directors salary and benefits 

3. Clerical salary and benefits 

4. Other personnel support (e.g., for time 
of school and service agency liaison, 
financial monitoring) 

5. Teachers' salary aad benefits 

6. Programmatic activities not covered by 
donated services and materials 

7* Transportation (home visits, trans- 
porting students to appointments, etc.) 

8, Costs of teaching materials, testing 

9 . Overhead (office space, utilities, 
materials } 



*If we cannot estimate the net costs of a fully 
implemented CIS, we can at least specify the gross dollar 
costs. The staff at one cf the new sites, Houston, 
consists almost entirely of outstationed personnel. The 
experience there may permit some inferences about 
long-term feasibility of re-placing human services staff 
in the school. 



57 

82 



The assumptions behind the numbers we attach to the 
cost elements are as follows: 



Personnel Costs . These vary widely across the 
country, our basic cost calculation assumes $18,000/year 
in salary and benefits for the Caseworkers, $12,000 for a 
secretary /assistant, and $24,000 for the Director. These 
salaries are considerably higher than the ones paid by 
CIS. They are used on the assumption that professional 
Caseworkers will be employed (with special training or 
directly relevant job experience).* 

We assume that the program is under the adminis- 
trative aegis of the school system, and that support of 
the program will require an aggregate of .5 person-years 
of various school administrators (Principals, personnel 
office, etc.) with average salary /benefits of $24,000. 

The costs do not assume that the Caseworkers are 
outstationed from existing agencies. Personnel costs 
associated with regular staff from those agencies are 
therefore not projected. 

We assume that teacher's of CIS classes will be 
drawn from the regular staff, will carry a teaching load 
equivalent to that of other teachers, and that the CIS 
program will not add to the total classhours that the 
school would otherwise support. No costs associated with 
teaching are included in this version. 

Costs of Programmatic Activities . It is assumed 
that the program obtains donations for such items as 
tickets to events and short-term use of facilities (e.g., 
a camp, recreation hall). CIS has been successful in 
this at all sites. A residual out-of-pocket cost of $5 
per student per month is added into the total. 

Transportation . We have arbitrarily estimated 
$.22/miie and 100 miles per Caseworker per month. 

Teaching materials, testing . It is assumed that CIS 
provides tutoring materials for the Caseworkers and 
conducts some special testing for self-evaluation 
purposes. The budget is calculated at $50 per student 

*In view of the evaluation^ continuing theme that 
better Caseworkers are essential, the assumption attempts 
to set a realistic projected cost for a "CIS that works* " 
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per year. This figure is higher than the program has 
experienced. It is used on the assumption that upgrading 
the tutoring and self-monicoring aspects of the program 
is a high priority of CIS, and that past expenditures 
would have to be augmented. 

Overhead . The costs of office space and the asso- 
ciated expenses can vary widely. In many high schools 
with diminishing enrollments, extra space is available at 
little opportunity cost to the existing plant. At other 
sites, space might have to be rented from a nearby house 
(following the Smith model). We use a figure of 
$(750/month in the calculation. 

Plugging these assumptions into a budget, we reach 
the following estimate: 



1. Caseworkers (12) $216,000 

2. Director 24,000 

3. Clerical 12,000 

4. School personnel 12,000 

5. Programmatic activities 8,640 

6. Transportation 3,168 

7. Teaching materials, testing 7,200 

8 . Overhead 9, 000 

TOTAL $292,008 



With a net of 12 student-years per caseload, the 
cost per student per year works out to $2,028. 

These figures represent a baseline from which a 
variety of permutations may be figured. The costs 
presented above are especially sensitive to: 

A cont inuing role for a national coordinator . I f 
the experience in multiple sites is to be shared, then 
the costs of maintaining a CIS, Inc. or an analoo organi- 
zation must be factored into the total. 

Implementation of special curriculum supplements . 
If a special educational program were to be installed 
that required more teachers than the school would 
ordinarily use, the teachers' salaries and support costs 
would add to the total. 
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Use of outstationed personnel on a large-scale . 
This option would require the budget ^ provide for 
liaison support from the regular social service agencies. 

In any option, however, the dominant cost is for the 
Caseworkers. The price per student swings significantly 
up and down depending on relatively small changes in the 
estimated salary of the Caseworkers, or in the size of 
the Caseload . 

Let us assume that the final figure for most 
configurations will fall between $1,800 and $2,200. Is 
this amount a large number or a small number? 

We have no metric for measuring it. The results 
from the CIS-that-was do not give us a basis for pro- 
jecting long-term dollar savings in the kinds of costs 
that CIS hoped to reduce — the costs of incarceration/ 
of welfare, and the others associated with dependency. 
And even under the best of circumstances, we could not 
calculate the value of the human support that students 
receive while they are in the program. 

The point of the calculation is not to drive 
decisions about CIS, but to inform them. The calcula- 
tions of costs versus benefits for CIS depend upon not 
upon the demonstration effort but upon a prudent projec- 
tion of what may be expected if the effort is continued. 
Material for assisting in that assessment is contained in 
Chapter IV. The figures presented here provide a basis 
for projecting the likely magnitude of the investment. 
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Chapter IV. 
The Potential of CIS 



Let us step hack for a minute and put Chapter III in 
the context of evaluations of other, analogous programs. 
Suppose that Chapter in were the concluding chapter, and 
that we were trying to draw lessons from the CIS exper- 
ience. Without exaggeration , this is what the "lessons" 
would amount to: 

"We have learned that a program which is in 
a developmental phase , receives uncoor- 
dinated and irregular funding from multiple 
sources, is constrained to rely heavily on 
untrained Caseworkers, has limited access 
to the social service delivery system, and 
works with adolescents who have a history 
of severe problems — such a program is 
unable to make major headway in solving 
those problems . 

We have also learned that, despite these 
constraints, the program can achieve a 
pattern of measurable benefits (Indian- 
apolis, 1978-79). However, this success 
was not repeated when the staff was reduced 
and a strike cut two months from the school 
year . " 

These findings are not particularly useful. But 
they are characteristic of evaluations of social action 
programs. Whether the program has been intended to help 
disadvantaged students, or welfare recipients, or drug 
addicts, or juvenile delinquents, the evaluation report 
has consistently concluded that "it doesn't work." Some- 
times the evaluator has gone further, and tried to specu- 
late about the program's potential if it were admini- 
stered under different circumstances (as we did in both 
Report No. 2 and Report No. 3 ) . But even in the process 
of doing so, an element of apology intrudes. Evaluators 
have been trained that a "dispassionate" assessment 
consists in taking a program at face value and assessing 
it relative to its promises, as we have lust finished 
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doing in Chapter III.* 



In this chapter we take another stance. Tt consists 
of two parts. The first part briefly resets the premises 
of CIS and of the evaluation. The second part examines 
the CIS experience in terms of the new premises. 



"PROBLEM REDUCTION" vs "SOLUTION-BUILDING" 
IN THE EVALUATION OF CIS 

We begin by drawing a distinction between what we 
shall call the "problem-reduct ion" and "solution- 
-building" approaches to program "development and evalua- 
tion. 

"Problem-reduction" has been by far the most common 
of these approaches, and CIS started life as an embodi- 
ment of it. So did the evaluation. CIS as a single 
program was not expected to solve the problem of failinq 
inner-city youth, but it was expected to reduce the 
problem a bit. Tt would save at least some of the 
students who came into its hands, and save enough of them 
to make the program cost-effective. 

Proqram goals have chronically been established on 
the basis of this strategy, and the evaluators have 
followed suit. The "positive changes" that evaluators 
look for are reductions in the problem that motivated the 
program — and reductions are what they fail to find. 

The pervasive error has been the premise of suffi- 
ciency. CIS, like analogous proqrams, was funded on the 
assumption that this particular addition to the existing 
mix would be enough to produce significant improvements 
in the status quo . We have become so accustomed to this 
way of thinking that its unlikely logic has seldom been 

V . 

'^Schwarz ( 1980} characterizes the standard approach as 
"program devaluation," and describes the dynamics of the 
Revaluation process that make negative results the 
f^pt)ed ictabls finding. His article is also the source of 
~the contrast between "problem-reduction" and 
"solution-building" evaluations* Because Schwarz (the 
President of AIR) has been AIR*s Senior Reviewer for the 
CIS evaluation, ana developed the article in part on the 
tjasis of CIS as a case in point, we borrow from his 
thinking in this chapter without further citation. 
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exposed. While CIS (or something like CIS) may be a 
necessary condition for progress, the sufficiency premise 
asserts that, for a significant number of its students, 
it is the only unmet necessary condition . 

One of the senior staff of CIS put it succinctly, 
wfien faced with data showing that even the students whose 
attendance improved dramatically were still failing most 
of their courses: "We have learned that getting the kids 
to school doesn't mean that their grades will get bet- 
ter." Seeing it stated ^explicitly , the natural reaction 
is "Of course — we all knew that." But in fact, neither 
program designers nor evaluators typically take advantage 
of that knowledge in setting goals and objectives. 

To use an analogy : CIS saw i tse If as baking pies 
(having major effects on a student's life). The evalu- 
ation was seen as counting how many pies were baked. The 
more accurate view of the situation is that CIS was the 
flour. An evaluation that counts pies is never going to 
be in a position to answer the more pertinent questions: 
How good is the flour? What else is needed to produce 
the pie? 

We propose an alternative to the problem-reduction 
strategy. We call it a "solution-building" strategy. It 
assumes that a given program — CIS in this case — is 
one component of the solution to the problem it 
addresses, and that there may be no visible change in the 
problem until all or most of the other components are 
present , 

The change posed for the definition of "success" in 
CIS is substantial. It does not let CIS off the hook for 
achieving positive outcomes. But it drastically shifts 
the foci of our attention, and the nature of the proof we 
are looking for. Under a problem-reduction approach, CIS 
asserted that 

CIS will significantly raise achievement 
measures (e.g., attendance, grades, test 
scores) of a significantly large proportion 
of its clients. 

Under a sotut ion-buildinq approach, the assertion is that 

CIS will significantly improve intermediate 
•performance measures that represent its 
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contribution to the eventual solution of 
the problem • 

We have tried to implement the approach by use of 
the "rationale" as described in Chapter ill. The appro- 
priate performance measures are not necessarily the 
obvious ones such as test scores, but the intermediate 
outcomes (e.g., increased effort in the classroom) that 
track whether the program is making progress in terms of 
the intended sequence of events. Thus, when the Indiana- 
polis program achieved a consistent pattern of improve- 
ments in these intermediate outcomes, we were prepared to 
interpret this as positive and important, regardless of 
the results on grades and test scores. 

But this approach to outcony£«r~does not resolve the 
diagnostic issue. We know that"%IS did achieve a consis- 
tent pattern of results in one of its sites. Tt achieved 
those results when the program was implemented most 
fully. From a diagnostic standpoint, this is a generally 
positive sign that the CIS concept has some validity. 
But this is not much help to a decision-maker who is 
faced with a different kind of question. The most useful 

diagnosti c information has nothing to do wTHF CIS as~~a 

program , Hut wit h lessons that may fvave^ been learned" ~~ 
about some of the elements of CIS. From this perspec- 
tive, the question to be answered is: 

Disregarding CIS as a specific program, 
what elements of CIS might be valuable in 
dealing with the problems that motivated 
the program? 

The rest of the chapter is devoted to extracting 
what lessons we can. Some are solidly grounded in the 
data; some are extrapolated from more isolated cases. We 
try to be explicit about which are which. 

CIS ELEMENTS AS PART OF THE SOLUTION 

CIS's truly distinctive bheme was the use of, small 
caseloads and intensive personal relationships between 
service-provider and client. Most high schools' have 
counselors, but they ser;ve large numbers of students and 
usually respond to specific events. Most social service 
bureaucracies have some sort of caseload arrangement, but 
either the caseloads are very large, or they are used 



ERIC 



90 



( J4 



only for special cases (e.g., chronic delinquents). CIS 
was unique in its application of the Caseworker as an 
all-purpose vehicle for problem-solving. In trying to 
derive lessons from the CIS experience, our attention 
shifts to these two sets of issues: 

The uses of the personal relationship between Case- 
worker and student . Is the relationship feasible on~ a 
program-wide scale? If so, what kinds of Caseworkers are 
needed? And, most important, for what is the rela- 
tionship useful? What kinds of specific functions can the 
relationship facilitate? 

The appropriate CIS participant . No one proposes to 
use a CIS-like approach for every student — it would be 
prohibitively expensive even if it were useful. Limiting 
criteria for participation are essential. Who can CIS 
help? Who can CIS not help? How can the two groups be 
distinguished? 



Personalism and the CIS Structure 

The personal, supportive relationship between a 
student and a specific Caseworker can operate as CIS said 
it would, and seems to be facilitated by the CIS struc- 
ture. The figures in Chapter III were based on the total 
population of Caseworkers, and they disguised the merits 
of the personal, holistic approach to students among the 
better Caseworkers. A review of the case files of the 
students with whom Caseworkers did develop the intended 
relationship justifies three conclusions. 

First, the assignment of the student to a specific 
person on the basis of general evidence of need rather 
than in reaction to a specific event has advantages. In 
the traditional school policy, a few "Deans" are assigned 
to take care of disciplinary problems, and they spend 
their time with the students who come to their attention 
for a specific event. The event (e.g., a fight) is dealt 
with. The student is then typically left to his own 
devices until a new crisis arises. The case histories of 
CIS stu^gnts repeatedly show the ups and downs that occur 
between these episodes. They show also that Caseworkers 
who are assigned to keep track of the student even when 
he is not being a visible "problem" can identify dynamics 

in the student's life budding problems in some cases, 

an upswing in confidence or energy in others. 




Second, the small Caseload is a crucial enablinq 
condition. Whether the proper number is 10 or 15 or 20 
is unclear. Tt depends on the students. Tf a proqram 
like CIS restricted itself to only the most difficuV 
cases, then ten is probably the proper size. Caseworkers 
who had ten such students (and the best Caseworkers 
tended to get that kind of Caseload) were usually fully 
occupied keeping abreast of them, including weekend and 
evening followup. if a program were to take manv mar- 
ginal cases — students with academic or attendance 
problems, but not much else — then the larger Caseload 
seems feasible. CIS Caseworkers in that situation tended 
to behave like their counterparts in probation offices 
and welfare aqencies, spending a large majority of their 
time on a minority of the toughest cases. Whatever the 
specific number, the fact that Caseworkers were able to 
give several hours a week, over a long period of time 
was said by the Caseworkers to be one of the major advan- 
tages of the CIS approach. Further, the students them- 
selves talked about the availability of the Caseworker as 
one of the common reasons that the CIS people were 
"different" from other adults, and were accepted as 
trustworthy. 

The "Family" concept (four Caseworkers grouped with 
their caseloads) has important facilitating virtues As 
CIS intended, Caseworkers in the best-run projects did 
interact regularly in assessing the state of the stu- ' 
dents, providing each other with an important back- 
stopping resource. We rarely observed the projected 
scenario — the exchange of professional expertises — 
because so few of the Families wore staffed by four 
professionals with expertises to share. But the mix of 
sexes and races did permit other perspectives to be 
voiced. More importantly, the clustering of Caseworkers 
gave the student an alternative. Matching student with 
the right Caseworker could not be done with precision 
before the fact. The Family structure provided an easy 
way to make corrections as more was learned about the 
youth's specific personality and needs. 

In sum, the structure seems to have been right for 
facilitating a Caseworker relationship with the student. 
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The Caseworker 



When the relationship was formed as intended, it seems to 
have had the virtues that CIS ascribed to it. But, as we 
described in Chapter Til, over the whole population of 
Caseworker/student relationships, a substantial propo- 
rtion appears to have fallen short of expectations: 
contact between Caseworker and student consisted of talks 
about a few specific school performance problems; the 
Caseworker's knowledge about the student was spotty; 
when a problem was recognized, it was perceived super- 
ficially. Are there structural reasons for this? Is it 
embedded in the nature of casework? Or could another 
program based on the CIS model reasonably expect to do 
better? 

In large part, the problems are susceptible to 
straightforward solutions. As we indicated in Chapters 
II and TIT , many of the problems associated with getting 
good Caseworkers can be explained by the sources of money 
and the amounts of money that were available. None- 
theless, the CIS experience highliohts the importance of 
using Caseworkers with specialized traininq and expe- 
rience* Out of necessity, CIS gave us an opportunitv to 
ask whether amateur Caseworkers can be effective. 
Judging from the CIS experience , the answer is "No.* 
Three types of problems were exacerbated by the use of 
Caseworkers with poor qualifications: 

The Role Model Function . According to Caseworkers, 
teachers, and some of the students, a minority of Case- 
workers were not positive role mddels. The complaint 
that Caseworkers "act like the students" — as peers — 
was frequent. The Caseworker was not someone that the 
student could treat as a source of guidance, but a friend 
who had many of the same problems as the student and who 
validated rather than challenged values that CIS was 
trying to change. The extreme cases — open acceptance 
of drug use and toleration of illegal activity are 
examples -- were isolated. A more widespread set of 
examples related to a generally lackadaisical attitude 
toward the kinds of infractions — getting in trouble 
with teachers, absenteeism, quitting a job because i** was 
too much trouble — that the Caseworker was supposed to 
discourage . 

This was especially troublesome because of the Case- 
worker's advocacy role. The Caseworker was supposed to 
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see that the student got a fair hearing, without approv- 
ing of the student's misbehavior. In many instances, 
teachers complained, the advocacy "role overshadowed the 
role-model function. In one instance, for example, a 
student who had struck a teacher was defended by the 
Caseworker against the teacher (in the student's pres- 
ence) on grounds that sometimes the provocation would 
justify striking a teacher. 

Parents also occasionally ha<i complaints: "I had to 
ask [the Caseworker! to leave," one reported, "because he 
dirt not respect us." Parents and teachers alike 
commented on Caseworkers' dress and manners. 

There is a matter of perspective in assessing these 
comments. It can be argued that the point of CIS is to 
establish close relationships with the students, not with 
other adults, and that the clothes and the talk and the 
values were exactly what was necessary to obtain that 
close relationship. But the nata do not support the 
argument: being streetwise, or having that image, was not 
associated with unusually close relationships with 
students . 

Educationa l Support. Tf Caseworkers are to provide 
educational support, they have to have a command of basic 
skills. Among Caseworkers with less than a college 
degree (and even among a few who did have a degree), many 
were not in a position to give their students much 
tutoring help, because their own skills were so poor. On 
occasion, the students themselves noted this fact: H I 
don't ask X for help in math. He doesn't know it. any 
better than I do." Again, Caseworkers were a source of 
evidence. Many expressed dismay about some of their 
colleagues' basic skills (e.g., in writing, mathematics). 

In still other instances., the Caseworker's mistake 
was not a matter of academic skills, but failure to do 
basic homework about the student and his academic his- 
tory : 

Ted had a good attendance record but 
terrible grades. His first Caseworker 
provided him with intensive tutoring sup- 
port. Ted finished his first CIS year with 
greatly improved reading scores and a C+ 
avorage. The next year, Ted had a new 
Caseworker. in intprviews in both the fall 
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and spring , the new Caseworker claimed that 
the student was motivated and had no 
problems with any of his subjects, and 
therefore was not receiving any tutoring 
help. In fact, Ted's gradepoint was a full 
point lower than the year before, and he 
was telling the interviewer that he was 
trying as hard, but the courses just seemed 
to be tougher. 



Needs Assessment . The main problem with using 
amateur Caseworkers stemmed from the complexity of the 
students 1 needs. The CIS experience illustrates vividly 
that a program which tries to deal with the most diff- 
icult students ends up with cases that call for judgments 
about very sensitive issues. The case files reveal 
numerous examples of Caseworkers who had questionable 
judgment m such instances. Note that "questionable" is 
the operative word. We have no third-party, objective 
assessment against which to judge the Caseworker's 
behavior. The accounts we cited in Report N o. 2 (pp. 
114-122) provide some detailed examples: The subsequent 
data collection continued_to show similar patterns . Far- 
example: 

Patricia tried to commit suicide and almost 
succeeded; she had to be hospitalized for 
two weeks. The Caseworker visited her 
often and tried to talk her out of her 
depression. Patricia continued to have 
behavior problems, and an attempt was made 
to arrange for psychological testing. The 
attempt failed, because the family did not 
qualify for public assistance. During the 
next school year, the school counselors 
again tried to set up psychological tes- 
ting. But, the Caseworker said, "I told 
the counselors that Patricia doesn't need 
the testing, she has been consistent in 
improving her grades and attendance." 

This is the kind of account that we label as "ques- 
tionable judgment." in this particular instance, it is 
compounded by an inaccuracy: Patricia's grades and 
attendance did not go up during the second year; thev 
went down. 
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Sometimes, the problem of judgment seemed to be more 
one of carelessness: 



Lucy's Caseworker took her to the bowling 
alley with some other students. She had 
been especially withdrawn, and had never 
participated in such activities, so the 
Caseworker had made a special effort to get 
her to attend. The Caseworker picked her 
up for the trip to the bowling alley, but 
at the end of the evening left her to find 
her own way home. Lucy finally had to 
walk. Her parents were furious, and refuse 
to let Lucy participate in any more CIS 
activities. 

Such instances were not isolated. Many of the 
students in CIS had complex problems. How does one 
appropriately deal with an attempted suicide? Or with 
suspected sexual abuse at home? Or with extreme with- 
drawal? There are no prescriptions? the state of the art 
in counseling leaves much to be desired? but the choices 
and the possibilities are much greater than many of the 
Caseworkers appeared to recognize. 

Often the symptoms were inconspicuous ones. The 
case histories frequently contained clues that are impos- 
sible to interpret at long distance, but which clearly 
need interpreting by the Caseworker on the scene. The 
case of Mark is illustrative: 

Mark lives with his mother and six sisters 
m a housing project. He is one of the 
better students in CIS. He attends school 
regularly and he never gets in trouble in 
class. He fails many courses, however, 
which is the problem that originally quali- 
fied him for CIS. 

Evidence started to accumulate that Mark 
lives in a fantasy world, believing that he 
attended a carpentry school during the 
summer, and talkinq about a close rela- 
tionship with his father (who lives in 
another city). Mark also refused to eat 
lunch in the cafeteria, and told the Case- 
worker he was in CIS because he was crazy. 
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All this was reported by the Caseworker. 
The Caseworker f s response to the problem 
was to try to shower Mark with attention 
and "attempt to draw him out." After the 
second year in CIS, the Caseworker recom- 
mended that Mark did not need CIS the next 
year because CIS "had broadened his 
horizons" — even though the fantasizing 
and the fear of the cafeteria continued. 

Judging from the record as presented by the Case- 
worker, some professional psychological evaluation might 
have been appropriate. 

This discussion does not argue that all Caseworkers 
should hold advanced degrees. There is clearly a role 
for training and staff development. The value of Case- 
workers who have street wisdom is not disputed. Perhaps 
simply a stronger admixture of trained personnel would 
provide the needed technical buttressing for those with 
little training. But if there is a single area in which 
a CIS-like program should focus its energies, it is in a 
careful selection and training of the Caseworkers, and in 
expeditiously weeding out the mistakes. 



The Uses and Limits of Personalism 

CIS's strongest argument for its approach may well 
be the potential it offers f.or making good on other 
inputs. Some illustrative examples from the case files 

• The orientation class is having a section 
on different types of careers? the Case- 
worker uses this as a basis for discus- 
sions with the student about his inte- 
rests, whichMeads into discussions about 
the training possibilities following high 
school . 

• A special reading curriculum is avai- 
lable, but the student tries to avoid it. 
The Caseworker uses her friendship with 
the student to get him to take the class, 
and gives him supplementary tutoring 
help. 
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• The student has a medical problem, but 
keeps skipping the appointments with the 
physician. The Caseworker takes the 
student to- the next appointment, 

• A student gets a summer job through a 
CIS-sponsored program. The Caseworker 
briefs the employer ahead of time, visits 
the job site regularly, and keeps the 
student on the job. 

In each instance, the Caseworker was not the 
provider of the service. The Caseworker was the supple- 
mentary resource who took advantage of the personal 
relationship with the youth. An examination of the case 
histories suggests that CIS was most successful when its 
Caseworkers were charged with this kind of specific, 
goal-oriented task. Rather than a diffuse charge to 
determine the student's needs and respond to them, the 
Caseworker had a concrete mandate: "The members of your 
caseload are enrolled in the remedial reading course. They 
will be pretested and posttested. We will be monitorinq 
the progress of your caseload. Make sure that they get 
tutoring." In such instances, the Caseworker had some- 
thing to do, on which it was reasonable to expect some 
-^losure^ -The same -spectei^ity^ap^Hed to the mandate ta 
track attendance and grades, and accounts for the 
generally intensive efforts that Caseworkers made to get 
the students to school . 

The specificity of the task facilitated the 
Student 1 c response. To do the things necessary to 
improve a grade-point average, the student had to make a 
global change in his stance toward school. But to attend 
tutoring sessions or get a physical examination called 
for a more limited compliance with the Caseworker's 
request, and this much seemed to be possible. 

The students 1 statements do not directly address the 
role of the personal relationship in facilitating the 
compliance. Only rarely did a student say things like, 
"I wouldn't do this for anybodv but my Caseworker." But 
statements about the Caseworkers being "different" from 
the teachers were common. "Thev really care," and 
variants on that theme, were voiced by" many. Others, 
when asked for an open-ended response to "What did you 
get out of the program," talked about the Caseworker's 
persistence in getting them to come to school. More 



directly, students who enioyed close relationships with 
the Caseworker would state that "I can talk to X like I 
can't with other people." These types of responses, plus 
the behavioral evidence of close relationships (e.g., 
hanging around the offices to talk to the Caseworker) are 
indirect evidence of the proposition that CIS has always 
advanced: The personal relationship enables other things 
to occur. 

The case histories are much less supportive of thei 
proposition that the Caseworker can o f ten have a genexa- 
lized impact on the student, independent of specific 
services and specific objectives. We will touch on this 
issue at more length in the following paragraphs. 

Who Should be in CIS? 

During the course of the evaluation, the projects at 
Smith, Arsenal Tech, and Julia Richman qave us an oppor- 
tunity to watch how CIS works for a varied population of 
students: poverty-stricken and middle-class, withdrawn 
and acting out; hyperactive and lethargic? from southern 
rural, Appalachian, and urban ghetto backgrounds? black, 
white, and Hispanic. The problems covered the range. 
Single-parent and no-parent homes were common, compounded 
by specific^ probl^m^ttrattn abuse, 
pregnancy, psychological disturbances, and incest. There 
was in addition a substantial minority that seemed to be 
slow learners, with no other discernible problem. 

Given this mixture, what inferences can be drawn 
about which students profit most from the CIS approach?* 
We stress the inferentia aspect; We do not have a large 
enough sample to test statistical relationships. And in 
the qualitative analysis, we must assume that our know- 
ledge of the "real* home and personal situation is 
imperfect. 

♦Given enough variance in the outcome measures, a 
quantitative supplement to this analysis would have been 
included, usirg regression approaches to examine the 
roles of background variables in facilitating success, 
Th_ j actual distributions contained such a small 
proportion at the plus side of the range that such 
analyses were inappropriate. The noise from the "no 
change" and "negative change 11 subpopulat ions dominated 
the results. 



The conclusion that seems most solidly 
the case histories is pessimistic: CIS did 
strate that its approach can permanently afi 
subpopulation of youths with the most sever( 
Some examples of what we mean by "most se\ 
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Student is in the middle,, of a bill 
custody struggle, Ts shifted frc 

Has been a victim of prolonged 



to home , 



neglect and physical abuse. 



Student is disfiqured; mav be one sourc» 
of another problem, extreme emotional 
insecurity. Is on probation for selling 
drugs. Is suspected of theft and 
burglary. 



• Student is the mother of two children. 
Lives with stepfather, who is unemployed 
and an alcoholic. May have been victim 
of sexual abuse by stepfather. Usually 
very withdrawn and sullen; sometimes 
suddenly aggressive. Functionally 
ill iterate . 



• Student has history of medical problems, 
is physically weak. History of violent 
behavior toward peers. Has run away from 
home. Once attempted suicide because of 
fear she was pregnant. 

In assessing CIS's ability to deal with these 
severely disabled students, our pessimism does not derive 
from an inability of CIS Caseworkers to establish contact 
with these students. Some of CTS 's most impressive 
s u ccesses were in the "reJ at lonships that Case w5rE57s were 
able to d evelop wit h st udents who had been un reachable. — 
The conclusion is based rather on a consistent pattern in 
the assessment of results by Caseworkers and students, 
and in obiective indicators; no source of evidence 
indicates that CIS achieves more than temporary improve- 
ments. Take, for example, one of the hardest of th* 
hard-core cases: 



Justin is a repeated runaway with a history 
of dealing druqs and violent behavior, He 
lives with his grandparents and sib li ngs in 
an unsupervised environment , His long list 
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of problems includes school suspensions 
(once for pulling a gun on another 
student), two stints on probation, and 
various altercations with a girl friend 
over a child he fathered. He seldom 
attended school and was failing all his 
courses when he came into CIS. His Case- 
worker worked intensively during the school 
ye^r, giving Justin individual attention in 
class, setting up regular tutoring sessions 
with the reading teacher, and persuading 
Justin to join in the programmatic activi- 
ties offered by the program. They would 
talk daily (when Justin came to school). 
The Caseworker was able to set up periodic 
sessions with a professional counselor. 

When Justin was interviewed at the end of 
his first year in CIS, he was emphatic 
about the respect and lose — his word — 
that he felt for the Caseworker. He said 
he was trying to improve his attendance, 
and attributed his efforts directly to his 
desire to please the Caseworker. He also 
said he had enjoyed the activities and 
appreciated the tutoring — "I feel like I 
have learned something for the first cime. w 

In terms of actual attendance and grades, 
no improvement was observed. Tn November 
of the next school year, Austin dropped 
out. 

At the end of his first year in the program, Justin 
exemplified the " investment * stage of progress. Improve- 
ments were not apparent in terms of the hard indicators; 
the evidence did indicate, however, that the first 
elements of progress were being achieved. Similar, less 
dramatic stories were frequent, with progress being 
described in terms of improved motivation, increased 
commitment to change, or more peaceful relations with 
peers. A typical accomplishment might be described as, 

"For the first six months, Anthony would^t 
even talk to me. Finally he did, and at 
the end of the year he was starting to come 
over to the r CISl office on his own." 
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Beyond this type of gain, Caseworkers very seldom claimed 
that significant gains had been made among the hard-core 
problem cases. Among that small set, it turned out that 
most had subsequently dropped out of school, or had 
regressed in the next year. The number of cases in which 
progress was claimed with no contradictory indications 
from other data sources was extremely small.* 

It should be emphasized that these remarks focus on 
visible results. Embedded in those cases is a good-in- 
itself that has an unknown value: youths who were 
experiencing extraordinarily disabling circumstances had 
a friendship with the Caseworker that was acknowledged to 
be positive, caring, and supportive. We do not under- 
value that accomplishment. Our conclusion is more A 
limited: in these most difficult cases, visible, behav- 
ioral gains were typically short-term, and did not 
survive the evaluation 1 s period of observation. 

It is at this point, however, that CIS did give 
evidence that it could make good on its referral function 
when it had Caseworkers who were either directly seconded 
by the social service agencies, or when the Caseworker 
realized that the problem was beyond the capacity of the 
program to handle. In Atlanta, where a regular staff 
member of the Department of Children anrl Family Services 
was assigned to CIS, Caseworkers throughout the program 
c^J.j.ed on her to help cut red tape, or for consultation 
about how to get help. Prom New York came this example 
of the referral role combined with CIS»s standard coun- 
seling functions: 

*Some explanation for this generalization is 
appropriate. In addition to the standard interview and 
archival material, we asked Caseworkers to nominate cases 
that they considered to be successes. Independently of 
those nominations, the evaluation staff rated each of the 
cases in the interview sample (see footnote on page 19). 
This produced a list of nominated successes. We then 
examined both the qualitative and archival material on 
these cases. The statements in this discussion refer to 
the cases rated as having a "severe" problem as described 
on page 19, and derive from {1} the very rare occasions 
when these files contained even unsubstantiated claims 
descriptions of progress, and (2) the additional 
attrition ?n our candidates when face-valid contradictory 
evidence (e.g., dropout, incarceration) emerged from the 
archival data. 
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Jacob lives with a "Grandf ather" who is 
really his father and a "sister" who is 
really his mother, and who deals drugs. 
Jacob loves school, and could cope with it 
well enough to reach high school. But his 
behavior has always been strange enough to 
get him the reputation of "the crazy kid" 
around the neighborhood. CIS was a delight 
for Jacob. He hung around the office, and 
the Caseworker became his buddy. The Case- 
worker also tried to counsel Jacob, visited 
the home, and eventually obtained psycho- 
logical counseling for him. When it became 
evident that Jacob would require institu- 
tional help, the Caseworker began the 
search for an available slot. That took 
time, however, and it was not until almost 
a year later that it was possible to place 
him. In the meantime, the Caseworker 
reported, other CIS students became 
protective of Jacob, shielding him from the 
"crazy kid" taunts that the rest of the 
school picked up. 

CIS can persuasively argue that without CIS, Jacob 
would have slipped between the cracks of the social 
service bureaucracies. Certainly he had done so for many 
years before CIS took him. Perhaps as important, CIS 
provided for him an interim home that provided him with 
support and comfort. 



With the severely disabled students, then, there 
seems to be room for the referral function. But it is 
not clear that the referrals resulted in long-term gains. 
And the evidence that CIS can work effectively in tandem 
with these supplementary services and have a synergistic 
effect is fragmentary. 

We have been asking, "What can a CTS-like program 
contribute to the mix of inputs that will make inner-city 
schools work." In the case of these most drastically 
disadvantaged students, the CIS approach has the capacity 
to establish a supportive relationship. It is much 
harder to infer from the record what might be done — 
added to the mix — that will yield the desired gains for 
the CIS population. 



ERLC 



103 

107 



A second group of students seemed impervious to help 
from another direction. These consisted of students who 
had poor qrades and attendance, poor motivation, but were 
otherwise unexceptional. They had apparently normal 
family situations, were neither withdrawn nor behavioral 
problems. They were not in trouble with the law. They 
did not show signs of untapped abilities. They were, in 
short, slow learners. A member of this subgroup typi- 
cally did not have an especially close relationship with 
the Caseworker, even when we limited the review to Case- 
workers who were known to have been successful in 
establishing close relationships with other members of 
their caseloads. With this set of students, the 
conclusion is 180 degrees opposite that for the dras- 
tically disadvantaged. it is easy to infer that these 
students need some combination of remedial education 
inputs; it is less easy to argue that the CIS caseload 
approach is an essential part of the mix.* 

The CIS success stories do not neatly fall into 
categories. Among those who were neither drasticallv 
disadvantaged nor simple "slow learners," there was a 
large random element: when the Caseworker was competent 
and tried hard, results were sometimes reported and some- 
times not. Sometimes the Caseworker saw progress when 
the student did not. Sometimes the archives revealed 
improvements in attendance c>- grades, while the Case- 
worker did not claim they were the result of CIS. Some- 
times the student reported that the program had been 
helpful in getting him through school, while neither the 
Caseworker nor the archival record indicated progress. 
Taken as a whole, however, three types of students may be 
especially susceptible to the kind of help that CIS 
offers. We discuss them with the understanding that we 
are extrapolating from relatively few cases. 



The first category consists of students who have 
problems, but who also have supports from home. The 

•If CIS were to exclude the students whose only visible 
problem was slow learning, it would have the side-benefit 
of diminishing eiS's reputation as being a "program for 
dumb kids," which was a problem at all three sites, 
especially at Tech. Tn the o^en-ended answers to the 
question, "What do your friends outside the program think 
about it?", the "It's for dumb kids" theme wan recurrent. 
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problem with this set of cases is that one of two things 
might be happening. Perhaps CIS was working in tardem 
with the parents, accomplishing together what the parents 
could not do alone. The other possibility is that these 
cases represent instances in which the student was going 
to improve anyway, and ClS's presence was superfluous. 
This example conveys the nature of the ambiguity. When 
we start with the statement of the problem and the 
change, it Jooks like a clear CIS success story: 



Ronald's reading jumped four grade levels 
during his first year in the progt. m, from 
2nd to 6th grade. Hir. grades were 
excellent — 5 As and 3 Bs in the last 6-week 
period — and much better than in any school 
he had attended previously. The parents 
and Caseworker a] ike observed that the 
student was very withdrawn at the beginning 
of the school year, whereas now he contri- 
butes regularly during classes and seems « 
proud of it. An evaluation observer 
confirms his present behavior — Ronald was 
the only one who was participating in a 
Junio t Achiever class session. Ronald 
himself attributes his improved academic 
performance to the greater help he gets at 
Tech, from the CIS staff, and a more 
relaxed atmosphere . 

Further, these outcome are occurring in 
the context of being the youngest of five 
children, in a family that has never 
graduated any of its members from high 
school . 



When the description shifts to Ronald's home life, 
the role of CIS becomes less clear: / 



The family is an unusually strong, suppor- 
tive one* As Ronald told it, the father is 
a hard worker who tries to give his chil- 
dren everything they need. They built a 
fishing boat together last summer. Mom 
likes to do ceramics; he and she work on 
hobbies together. Together, the family has 
done a lot of work on their house — 
paneling, carpeting, insulation, a complete 
renovation of the kitchen. Ronald feels he 
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has learned a lot by this and is proud of 
his accomplishments, Beinq the youngest is 
an advantage — you can see ^\\at your 
brothers have done and learn from their 
experiences , 

So he does not participate in the program- 
matic activities at Tech; he would rather 
go home. He sees the Caseworker as a 
friend , and feels comfortable talking to 
her. But if he has a personal problem, he 
talks to his parents about it. The Case- 
worker is fine, but she's not family. 

Of the examples of this type, we have found it 
impossible to disentangle the relative contributions of 
the home supports and CIS. But it would be consistent 
with the experiences of parents and adolescents every- 
where that adolescents do not always turn out right -just 
because the parents are good parents. Additional 
supports are often needed to fill in the gaps, 

CIS had the capacity to perform this supportive role 
in family settings that were much less secure than 
Ronald's. Successes were observed i n family settings 
that #ere were single-parent, poor, or with other severe 
disadvantages. The key seemed to be whether there was at 
least one parent who was providing love, attention, and 
discipline, and was determined that the child succeed. 
Arthur, one of the mo^t cleat -cut success stories in the 
case files, is an example; 

Arthur f s father is in prison. He lives 
with his stepmother and several of his own 
siblings and step-siblings. The apartment 
is located at the streetcorner that is the 
drug dealing center of the city. 

In the year befor fining CIS, Arthur 
missed 55 days ot jol. When he did 
attend, he got in tiqhts. He was on proba- 
tion for vandalism, and extorted lunch 
money from the younger students on their 
way to school. As the Caseworker noted, 
Arthur was mean. 

The only visible asnet in Arthur*s envi- 
ronment was his stepmother. The Caseworker 
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reported that she was a strong personality, 
who had managed to make a close family out 
of the assorted children in her care. She 
was deeply concerned about Arthur's 
behavior and school performance . 

The Caseworker provided intensive coun- 
seling and academic help. Arthur's step- 
mother and the Caseworker collaborated in 
checking on his homework, and in trackinq 
whether he got to school after leaving from 
home. They surrounded him. 

During the second term in CIS, Arthur's 
attendance improved dramatically, to near- 
zero absences. He stopped fighting. He 
stopped stealing lunch money. He started 
passing his courses . 

The improvement continued throughout the 
second year in CIS. By the last interview, 
he was making plans to become a veteri- 
narian. From the interviewers notes: 
"Arthur said he had learned more because 
while in the regular classroom the teacher 
will not take time to help you, CIS staff 
will.... «it [CIS1 is all about caring, 
one big family that is helping me push 
myself forward, showing me the right thing 
to do . ■ " 

The combination of the supportive parent and the 
Caseworker seemed to be the key ingredient in these 
stories. Parents who were interviewed, especially single 
parents who had a fulltime job, consistently saw them- 
selves in need of support — they had the motivation, but 
not the time, to look after the problems that had put 
their child in CIS. Further, the comments of the parents 
often explicitly gave the credit for improvements to CIS. 
These are the remarks of Arthur's stepmother as noted by 
the interviewer: 

Arthur wouldn't have made it in the regular 
school. rcrsi has enabled Arthur to think 
about things that aren't offered in life 
for him, and about what he would like to do 
when he completes high school. He isn f t a^ 
mean as he once was and is more respon- 
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sible. The program has affected the whole 
family because the other children talk 
about how Arthur has progressed. It [CIS] 
has helped all members of the family to 
communicate with each other. 

The second category of CIS successes involved 
students who already were showing signs of motivation , 
but who faced a discrete, concrete, fixable problem that 
CIS could solve — or at least reduce. This type of 
student is very close to the one that was mo<*t often 
described in CIS^ descriptions: the girl who is missing 
school because she has to take care of her little 
brother; or the one who has to work full-time because 
the family is not getting AFDC assistance; or the 
student who had a chronic undiagnosed medical problem. 

Sometimes the problem was not only a physical or 
econon^jc^rie jF ^J5lS also was able to deal with a sudden, 
crisis situation — the death of a parent, or desertion 
by a parent. The common denominators in the cases we 
group under this category were that the problem was in 
some sense "delimited ," and th?t the student had visible 
assets of motivation, and receptivity to help. 

The nature of "success" in these cases was less often 
a dramatic turnaround (often the students were doing 
reasonably well already), but rather that the .student 
maintained the status quo in an situation that£jcould have 
been expected to be disabling: 

Alice was referred to CIS because of a 
sudden drop in attendance and grades, after 
a history of normal school performance. It 
turned out that she had become extremely 
upset by her father *s death, and feared 
that her mother would die *s well. 

The Caseworker focused her counsel ing on 
the grief and fear triggered by the ' 
father f s death. After several months of 
intensive interaction, attendance and 
grades returned to normal and remained 
there during the second year of obser- 
vation. 

Perhaps the specificity of the problem is less 
important than the level of the student's motivation. 
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The following is an example of CIS apparently working 
with both a general ized* and a specific problem: 

John had been living in a loosely super- 
vised environment for several years. His 
mother was an alcoholic and spent most of 
her time with boyfriends. He took to CIS 
very quickly. He liked the programmatic 
act iv i ties and 1 iked the Caseworker. John 
had no major behavioral problems other than' 
skipping school. The Caseworker continued 
to track him down when he skipped, and 
John's attendance improved substantially. 

Shortly after these improvements had seemed 
to stabilize, John's mother left town 
abruptly. The Caseworker provided 
immediate temporary housing for John, then 
helped arrange for John's grandmother to 
take him in. As of the end of observation, 
John was continuing to attend school 
regularly. 



CIS's accomplishments in this case followed the 
intention of the program very closely: The Caseworker 
was on hand at the time the problem arose, and could move 
quickly to avert a potentially crisis situation. In such 
cases, the merits of the ongoing relationship and the 
daily contact that the CIS" approach provides are apparent 
— there was no need to wait for John to think of 
approaching his grandmother, or for a social service 
caseworker to become aware that John was on the streets. 

The third of these overlapping categories consists of 
students who probably "should not" be in the program in 
the first place. That is, their problems are said to be 
minor: the parents are not an active problem, but not 
very supportive either? grades and attendance are not 
good, but not failing; there are no overt behavioral 
problems. In some of these cases, CIS seems toJiave 
given the necessary nudge. The most common pattern was 
that CIS was instrumental in qiving the student career 
aspirations : 

# The tenth grader whose Caseworker got her 
interested in cosmetology, and who raised 
her grades to get into a cosmetology 
school . 
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• The student could barely cope with his 
academic courses , but could draw, and 
whose Caseworker then laid out a program 
that put the student into vocational 
traininq for draftsmen. 

• The student who worked as a volunteer at 
a hospital through one of CIS f s programs, 
and subsequently improved both attendance 
and grades in an effort to get into 
nursing school. 



There is, of course, a problem in interpreting these 
examples. Wduldn f t the student have stumbled onto some 
other aspiration and reacted the same way, because of 
som^^ther event if CIS weren«t there? But if the 
question is the potential of CIS, it seems fair to 
conclude that the traditional "mentor* function is one 
that CIS can play. Among the students that CIS takes, it 
also seems fair to say that very few other adults in the 
school have the time, or in some cases the interest, to 
perform this function. 

Who belongs in CIS? If the question is put in terms 
of, "Who is most likely to benefit?" the answer that 
^merges from the examples of success seems to be: 
Students who come to the program with at least some sort 
ofyasse^T The asset can be a strong parent, or the 



s existing motive*- ion. It can be a combination 



of minor assets — a littlo motivation, reasonable levels 
of academic achievement, an<* no major deficits. The 
student without any visible assets — ,with problems at 
home, no signs of self-starting, behavioral Problems, few 
basic academic skills ~ -nay be retrievable , but not by 
CIS alone. * 1 
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Chapter V. 
Conclusions 



The final step in any evaluation is to try to 
synthesize the evidence that was assembled, to make one 
or more summative statements about the program's value. 
In the case of CIS , this can be done at several levels. 
If the summative question is the simplest one, 

"Is the program as it exists a good invest- 
ment of public funds? 15 

the answer* from the three sites that we examined is "no." 
In one year, in- one site (Indianapolis in 1978-79), .the 
program could point to evidence of a pattern of positive 
results. Elsewhere, and in other years, the program did 
not demonstrably affect the behavior of large numbers of 
its participants. The best that can be argued from the 
record is that perhaps things would have been even worse 
without CIS. Lacking adequate comparison groups, that 
possibility remains open. The data that bear on the 
issue cast doubt on that proposition. 

At the next levels the question becomes, 

"Can the factors that limited the program* s 
effectiveness be corrected?" 

•Three types of impediments limited ClS's results? 
The "way the program was funded and structured by its 
sponsors, the way the program was run by its admini- 
strators, and the responses of local agencies and school 
systems. 

Of these three, the dominant factor was the funding 
arrangements. Even if the other problems had not 
existed, the program's ability to implement the planned 
CIS would have been crippled. The most important impedi- 
ments were: * 
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• The multiplicity of funding agencies . 
Each had its own agenda and its own 
requirements. 

• The fragility of the funding . Case- 
workers typically could be guaranteed 
only nine months work — sometimes not 
that. Plans for allocation of resources 
could not be made more than a few months 
in advance. Even funds that were 

* contractually obligated were chronically 

late, forcing a series of financial 
crises on the program. 

• The requi rements of the funding . Some- 
times the money could be obtained only by 
doing things that were guaranteed to 
create problems. Title XX money could be 
used only if the student met certain 
economic criteria — but meeting those 
criteria did not guarantee that the 
student was one who needed, or could 
benefit from, CIS. CETA lines used for 
hiring Caseworkers forced the program to 
choose from a poorly qualified pool of 
applicants. 

• The level of the funding . The .salaries 
tfiat CIS paid tor the Caseworkers it 
hired could not compete with those in the 
schools or other public service agencies. 

The implied changes are not exotic. They are ones 
that would put a CIS-like- program on the same financial 
aafn^^^fi footin 9 as - the typical established service 
fhSS J; Ift ?1 v ar ! made ' it is reasonable to expect - 
»23i the y. WOuld enable the program to make major improve- 
ments in its staff, its long-range planning, and its 
monitoring. 

rid Th , e "f econd factor was the internal administration of 
CIS. Early in the program's history, it was a major 
fJ?Q? r \K the time Report No. 2 was written (spring, * 
l llh critics of the program's administration were 
numerous and vocal (see Report No. 2 . Chapter 5). Sn 
this count, however, changes have occurred. We cannot 

J?™*^! t f l GCtS ° f the ext ensive administrative renova- 
tions that have occurred « most of them began well into 
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the last year of observation. But, in any event, the 
question at issue is not whether CIS, Inc. has become an 
efficient, businesslike operation, but whether it is 
reasonable to expect that a CIS-like program could be 
designed to run that way. Nothing in the early criti- 
cisms of CIS suggests otherwise. The problems were 
managerial, with managerial solutions of the kind that 
CIS is now trying to implement. There was no inherent 
conflict between them and the CIS approach. 

The third source of limitations to the program's 
effectiveness was the stance of other social service 
agencies and of the school systems. In CIS's calcu- 
lations, these have loomed as large as the funding 
problems. Strategies for encouraging agency cooperation 
and developing workable relationships with the school 
systems have been complex and changing. CIS identifies 
many of its problems with the compromises that h$ve been 
necessary to gain access to the demonstration sites.. 
Earlier reports of the evaluation have focused on this 
aspect of CIS's experienced But our reading of the 
evidence is that many of these problems have been func- 
tions of the way CIS has been funded and managed. By and 
large, the complaints voiced by other elements in the 
social service system have been accurate ones, grounded 
in legitimate considerat i®n$. Given stable financing and 
management, the source of many of these doubts would be 
eliminated. If the question is, "Can the human services 
delivery system be reconfigured, in the way that CIS 
originally envisioned?, 14 then the jury is still out. But 
the limiting factors in the CIS experience that we evalu- 
ated were primarily grounded in the funding arrangements 
and CIS's own administrative choices. 

In sum: Most of the major limiting factors that we 
observed seem to be fixable. The fixes do not depend on 
charismatic leadership, drastic modifications in the 
basic CIS approach, or complex systems. Specifically, we 
identify five basic conditions that could be met by a 
CIS-like program and that are fundamental. These condi- 
tions would ensure that a CIS-like program could: 



• have an assured budqet, and funds that 
arrive on time; 



• offer year-round positions for a period 
of more than one year; 
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workers from the general pool of 
social service workers, remedial educa- 
tors, and other types of youth workers; 

• sustain the caseload contact over the 
summer; and 

• choose its students solely on criteria 
of need. 

Given a CIS that meets these conditions, we now ask, 

"If these .changes are made, will the resul- 
ting program yield the desired benefits?" 

The answer has two parts. One relates to the services 
that the program. provides. The other relates to the 
behavioral impact of the program on its clients. 

^ Effects on Services. Taking the record as a whole, 
approach - SUPP ° r theSe positive state *ents about the CIS 

• At its best, the student's relat ioriship 
with the Caseworker was a close, confi- 
dential, supportive one, often the only 
such relationship with an adult. 

• CIS demonstrated its capacity to develop 
these relationships with students who are 
believed to be the most difficult to 

• reach . 

• Even, when the relationships were more 
superficial, the small caseload and the 
Caseworker's location in the school 
facilitated knowledge of the student that 
very few teachers cpuld match and an 
availability to help that centrally 
'located service workers could not match. 

• CIS demonstrated that the school location 
and daily presence can facilitate 
screenings for service needs (e.g., 
medical examinations, checks on basic 
welfare needs) that would not have 
occurred otherwise. 
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• Through its programmatic activities, CIS 
provided opportunities for sociifl and 
cultural developmental experiences that 
would not have occurred otherwise. 

On the negative side, there was really only one 
major finding: 

• These positive things could ,h,ave happened 
more often and more consistently . 

The critical evidence cited in Chapters III and IV 
was almost exlusively about failures to do good, not 
about negative results. The criticism was that some 
Caseworkers failed to learn enough about the student's 
needs, not that anyone else knew more; that sometimes 
Caseworkers failed to provide services, not that ajiyone 
else would have provided them otherwise; that some Case- 
workers were poorly qualified, not that a qualified 
alternative was standing by. 

The only evidence of outcomes that were truly 
negative — that the program made the students worse off 
than they would have been without CIS — was skimpy. 
There were repo-ts, mostly from one site, of negative 
labeling ("CIS is a program for dumb kids"), a handful of 
instances in. which the Caseworker's actions were probably 
worse than doing nothing — and that is about all. 

Given this situation, CIS (or an analogue) is not in 
the position of having to alter the programmatic direc- 
tions of its efforts. It has only to do more often what 
it already knows how to do. And the ways to do that — 
.get good Caseworkers and manage them effectively — are 
the purpose of the fixes. It seems reasonable to predict 
that their effects would be to increase substantially the 
level of the "input" that has been CIS's most attractive 
feature. 

We add two important cautions. First, the size of 
the program is likely to be an important factor. If a 
program is the size of the one at Smith ~ about 120 
students with about 12 Caseworkers — the program should 
be able to recruit enough people with the qualities that 
are required m a Caseworker. It is much less clear that 
enough of the right pecple can be found to staff a 

program that tries to maintain several hundred students 

on caseloads. s 
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Second, the fixes that were listed above are to some 
extent at odds with one of CIS's major objectives: to 
staff itself with outstationed staff from other human 
service agencies. CIS reports that some of its best 
results are emerging from a program that has done just 
that (in Houston). We simply note here that the task of 
selecting the right Caseworkers is central to improving 
CIS's inputs, and that this is inherently more difficult 
to the extent that the selection of Caseworkers i<* i- a ken 
out of the program's hands. 

„ TCI Nonetheless, the essence of our conclusions about 
CIS s inputs is that (1) CIS demonstrated that they were 
feasible, and (2) some straightforward changes in staf- 
fing and management could be expected to increase their 
consistency and intensity across all participating 
students. * 

Increasi ng the Pr og ram's impact , would these 
changes produce the kinds of effects that the program 
hoped to see — improved attendance, improved academic 
performance, and, in the long run, an improved chance to 
make good as an adult? 

Our data permit us to say very little. The pattern 
of improvements that was observed at Tech in 1978-79 
occurred when the program was also being most fully, 
faithfully implemented. To this extent, it is reasonable 
to expect that results on the outcome measures will 
follow from better program content. 

Other results are less encouraging. CIS when imple- 
mented as planned constituted an unusually intensive 
"treatment." Most remedial programs for the kinds of 
youths that CIS served last for weeks or months, not 
years, and the level of contact is usually measured in 
number of contacts per month, not number of contacts per 
day. CIS was correct in pointing to its unique charac- 
teristics, and this uniqueness did qive some cause for 
noping that, for once, dramatic results might be 
obtained . 

It was t 1 -** highly concentrated effort that prompted 
one observer to remark at the outset of the evaluation 
tnat the most provocative finding about CIS would not be 
if it was implemented as planned and found to work, but 
it it was implemented as planned — and failed. In this 
context, one of the findings of the evaluation that 
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cannot be ignored is that even when everything went 
right, there was very seldom a visible effect. The 
Caseworker would be capable, energetic, determined. The 
needed services would be found. A close personal rela- 
tionship would be developed. The student would tell the 
interviewer that the Caseworker was the one person who 
understood him, that CIS was one of the best things that 
had happened to him, that he was learning more than ever 
before, seeing new possibilities for the' future -- and 
then the records would show that he was becoming more 
truant, or more truculent, or 'more delinquent. 

The data from the Indianapolis experience suggest 

i5« t |. eV -^ enC 1 2L more P r °9 ress w iH be forthcoming if the 
input side of CIS is improved. The data from the indivi- 
dual case histories suggest that the progress will 
probably be concentrated among the students who already 

:u V ! ™ m ° St going for tnem ' Jt is ' not at all clear 
that CIS is an answer for any appreciable number of the 
worst-of-the-worst among the nation's problem youth. 

Perhaps the best way to close is with a true case 
that captures the ambivalence that has characterized this 
evaluation. It was drawn from the Indianapolis sample: 

Mary lives with her mother and two 
brothers. One of the brothers is a 
problem: he beats up on Mary and "tears up 
the house" (five times this year alone). 
Twice, he has pulled a gun on Mary. He has 
dragged the mother down the stairs. Mary 
wants someone to check the brother. The 
mother will not do anything about it; she 
is afraid of him. Mary tends to be sickly, 
and miss school. This is exacerbated 
because the mother keeps her home from 
school for any excuse. The family has a 
long tradition of not finishing high school 
(Mary wo-jld be the first in her family to 
do so), and the Caseworker can cite 
instances that suggest resentment at the 
idea of Mary breaking that tradition. 

When Mary joined CIS, she was absent most 
of the first term. The Caseworker kept 
working with her, however, and there was a 
dramatic turnaround in the second term. 
Absences went to zero, and Mary started 
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making A 1 s and B's. As far as the Case- 
worker cm figure it out, Mary had always 
had the inte'll ioenee and the ambition, but 
she had been taught that she was not 
supposed to .succeed, and CIS's contribution 
was to tell her that it was not only 
possible to succeed, but a good thing to 

do. The mother continued to be obstructive 
{ e . a . , bv mnrp] 1 i nn nprn) i cc Jnn e^*- m->~*» +. ~ 

go on an activity at the last second), but 
at the end of the 1978-79 school year, Mary 
had gone from a failure to an unequivocal 
success ~- by her testimony, by the Case- 
worker's, and by the records. 

During the summer, there was no CIS 
program. Then the strike kept Mary away 
for another two months. When school 
returned to- normal in late October, she had 
rel.-fpsed. Her mother continued to keep her 
home under any pretext. Mary's new 
Caseworker had no more luck than the 
preceding one in getting through to the 
mother. And Mary herself was seen by the ' 
Caseworker as listless and lacking motiva- 
tion. The grades dropped back to D's and 
F g s. Absences went back to the levels of 
her pro-CIS years. 
» 

Thus the choice in assessing the potential of CIS: 
The program achieved what could have been a decisive 
change in the trajectory of this girl's life. "She says 
she knows what she want? to do now," wrote the 
interviewer in the spring of 1979, "and regrets the time 
she has already wasted in achieving her goals." She was 
going to be the first in her family to graduate, the 
first to have a skilled job. She was proud of being on 
the honor roll, croud c. getting an A in a class she had 
flunked the previous term. And it came to nothing. 

The "what ifs" are many. What if, for example, a 
program lid not drop the student for 3 months during the 
summer (5 months in this case, because of the strike)? 
What if the same Caseworker hai been available in the' 
second year? what if, once she came to school, she had 
been fed into a curricuJum tb=?t excited her? What if the 
Caseworker, *-hc r.ade only two home visits (and was openly 
resented by M*n wrr) had been trained to deal with a 
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hostile situation, and had been able to get through to 
the mother? 



Nobody can be sure that any of the "what ifs" would 
have retrieved the situation. But the "what ifs" are 
plausible. There is no sense of inevitability in the 
history of CIS. 

The data for this evaluation support all three of 
these statements: CIS as a whole did not achieve its 
objectives. CIS under certain circumstances did achieve 
many of its objectives. * CIS was implemented in ways that 
demonstrably diminished the impact that was possible. 

Those capsule conclusions do not constitute a 
prescription for policy decisions. Our own view after 
three years of watching and evaluating CIS is that more 
is known now about how to make a CIS-like program work 
than was known before. That increased knowledge ought to 
be built upon. Some of the fixes suggested by the 
evaluation ought to be tried. And if that is done, it is 
probable that the process will have to go through yet 
another iteration, and perhaps a third, fourth, or 
eighth. Each time, it is reasonable to expect that more 
will be accomplished, more efficiently. 

This is not, of course, the way things are done* It 
is more likely, given the history of other programs, that 
CIS will be tossed aside — not just CIS, Inc., the 
organization and the specific program it developed, but 
the special ideas it contributed and the steps forward 
that it took. Soon* another solution will spring up. It 
will be given a shot, of sorts, found not to be The 
Solution after all, and discarded. 

Let us pose this choice. On the one hand, it may be 
decided that inner-city schools are never going to work 
until fundamental changes take place in the communities 
that surround them. The problems are too great, the 
competing influences are too strong. The best we can do 
is take the few students who somehow have resisted the 
influences, and educate them. 

Or, we may start by trying to visualize an inner-city 
school that does work, and trace our way backwards to 
what must be part of that success. A good curriculum 
will be a component — a curriculum that can successfully 
be taught to this particular set of students. Good 
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teachers will be\a component, ones who have the training 
and are given the ?kdministrat ive support necessary to 
teach effectively, and to qovern^ their classrooms. But 
in visualizing the inner-city school that works, it also 
seems inevitable that. there will be some sort of addi- 
tional component to provide one-on-one, continuing 
support to students who are facing special impediments. 
It will have to be something more than can be provided by 
counselors who have school-wide, responsibilities. A 
caseload arrangement will probably be necessary. The 
counselors will have to have access to noneducational 
resources, because so many of the impediments will call 
for noneducational solutions. And probably it will be 
helpful if these counselors ha^e an identity that sets 
them apart from the academic staff, to facilitate their 
mandate to look at the youngster a whole person, not 
just as a student* 

We do not reject the first choice out-of-hand. The 
data collected for this evaluation by no mtans promise 
that there are solutions. Maybe nothing will work by the 
time that adolescence is reached, and programs will have 
to focus on the earner years. But if the choice is to 
keep trying, then the lesson of the CIS evaluation is not 
to toss CIS aside and hope for something better. The 
more reasonable assumption is that "an inner-city school 
that works" will include as part of its resources some- 
thing very like CIS, and that the most economical way to 
reach that goal is to build on the start that CIS has 
made » 




120 



124 



ERiC 



Appendix A. 
Commentary by CIS 



For the past three and a half years Cities in Schools 
has been evaluated by AIR • Much as a pediatrician would do 
an initial assessment on an infant, identify key variables 
to check regularly, and followup through childhood, so AIR 
set ud its initial research/monitoring desian and followed 
it for the three years of CIS 1 infancy. Also, much as the 
pediatrician would confer with the mother and both adjust 
their input so the child would grow healthy and strong, so 
have AIR and CIS staff proqressed through CIS 1 infancv - AIR 
providing feedback at key checkpoints and CIS staff 
adjusting conditions where indicated to facilitate qrowth 
and development. It has been an "interactive" relationship 
between evaluators and evaluatees. AIR was the objective 
pediatric evaluator of growth and progress, CIS staff were 
the nurturinq parents. 

Sincere and deep appreciation is given to Charlie 
Hurray and Cherry Bourque of AIR, who worked so closely with 
us in the evaluation. They made every effort to assist us 
in our internal oroaram assessment, identifving. areas of 
concern and areas of success. We didn't always agree and 
aroued vigorously at times. On one key issue in particular, 
however, we did agree — that at the end of the three-year AIR 
evaluation the program was just at the beginning point of 
being ready to be thoroughlv evaluated! The infant was new 
on its feet, ready for the first road race, and the race was 
over . — There are three areas f in-particula^ r in which CIS 
felt the evaluation did not give a true or complete picture 
of the program. 

First, there were some very imoortant variables on 
which AIR and CIS remained in disagreement after the 3-year 
evaluation. Second, there were some very important 
variables which were not covered in the evaluation at all 
because thev entered the picture after the evaluation design 
was fixed, and so remained out of the design framework. And 
third, there were some program facets which were functioning 
throughout the evaluation period, but. which were excluded 
from the design because of functional and- budgetary 
constraints. 

Because the evaluation was truly interactive, CIS has 
been afforded this opportunity to respond and provide 
additional information to AIR's report. We include: 
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A. Descriptive informative on: 

1. Areas in which we regain in disagreement. 

2. New Droqrams and proiects not evaluated 

bv AIR. 

3. Sxistinq projects not evaluated bv air. 

B. Conclusions 



* * * 



* * # 



1. Areas of n 



isaqreement 



ATTRITION 



AIR states that one of the reasons it was difficult 
to evaluate lmoact data was the hiqh attrition 
rate, while attrition certainly hampered the evalu 
ation, CIS felt that some additional statements 
should be offered to clarify the overall situation. 

Attritio n is not analogous to "drop-out " CIS re- 
cords attrition in 13 categories in its Management 



^ f o r ma tion Syst e m (MIS). Se v en ca tegwres^are"corr 
sidered negative (Employment - a student should not 
have to stop school to work, lost interest, preg- 
nancy, family oroblems, institutionalized, expelled 
unknown - we should be able to find out), three are 
considered neutral (relocation-family moved, health 
problems-some traumatic conditions such as cancer 

?™n/~ Sh S Ul ? be ex P lain «d), and three are positive 
(GED/qraduation, other school/traininq, armed ser- 
vices). 

Tran sferring to another school is not c onsider^ a 
negative terminatio n. Many Students in CIS come" — 
from broken homes, one-parent families in unstable 
circumstances and sometimes these families move 
often. When we look at CIS students in comparison 
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to other students in their schools, however the CIS 
mobility rates are not— at least in Atlanta'-siqni-^ 
ficantly hiqher. 

" In Atlanta, and Indianapolis, overall termination 
rates are decreasing - : In Atlanta, rirst and second 
Quarter data tor 7P-79 showed a 32% termination 
rate, and for the same period in 79-80 the rate was 
23%; in the third quarter of 79-80 the "rate was down 
to 18%. In Indianapolis, overall CIS terminations 
dropped from 554 in 1978-79 to 336 in 1979-80. In 
78-79, 57% of those terminations were neqative, and 
in 1979-80 the percent of neqative terminations 
dropped to 34%. 

~ At least two adjustments in the Atlanta attrition 
data have been made since September, and CIS figures 
still go not agree with AIR 1 ^ In the fail o^ 1980 
AIR reported tnat at the end of 2 years, 26 of their 
Atlanta sample of 74 CIS students remained partici- 
pants and an additional 8 remained in school but not 
as participants: a total of 34. The rest had 
"dropped out" or their status was unknown and they 
were considered probable dropouts. , 

CIS countered with data that showed that an addi- 
tional 14 of the reported dropouts from the oriqinal 
sample were still attendinq school somewhere. In- 
deed, 3 of them were still enrolled in CIS, 7 were 
in the reqular program at Smith, 3 were on the 
active roll at other Jiiqh schools, and one 
w as s tudy in g while- a Job Corps participa nt . 

" Students do not enter CIS on permanent status . For 
most, it is a one-year program. For those with 
severe needs, perhaps two. In some circumstances, a 
student might be mainstreamed back into reqular 
school with only occassional follow-up monitorinq by 
f*IS staff. So, it would not be unusual for. partici- 
pant-status attrition to be quit** hiqh over a two- 
vear or longer period. CIS recoqnizes that the 
lenqth of time a participant should spend in the 
program to derive maximum benefit is a variable 
which needs to be studied. 

- It should be reiterated that while still consider- 
able ' CIS attrition is not abnormal for an inne r 
city school. It created" an evaluation probTenTfor 
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AIR, but should not reflect negatively on CIS 1 capa- 
bilities. As noted, when Drogram^wide attrition or 
termination rates are studied, it is apparent that 
CIS has, in fact, been qradually lowering the termi- 
nation rate for its students. Table 1 shows termi- 
nations as a percentage of total CIS caseload en- 
rollment, by city, for, 1978-79 and 1979-80, 
Atlanta's fiqures are high because four of the seven 
orojects were Street Academies. Students in the 
Street Academies are vouth who have already dropped 
out of school, and are generally older than in-s^)l 
students. Thev have more severe behavioral and 
social problems, and tend to enroll and terminate 
and re-enroll. D.C.'s rates are hiqh because the 
school is located in a very hiqh mobility housing 
project neighborhood. When terminations are broken 
down by tvpe f in Atlanta and Oakland only 17% of the 
terminations were for negative reasons, in New York 
only 7% and in D*C. only approximately 2%. Houston 
and Indianapolis fiqures had not been recorded. 



Table 1 

Terminations as a Percentaae of Enrollment * 





1978-79 


1979-80 


Atlanta 


48% 


41% 


Indianapol is 


43% 


36% 


New York 


20% 


20% 


Houston 


** 


15% 


Oak! and 


* 

11% 


17% 


Wash inq ton, o.C. 


* 

40% 


40% 



* These two cities were only operating for a part of the 
school year 1978-79. tt would be expected that had they 
been ooen all vear f the termination rate would have been 
higher. Both were Jr. High proiects. 

** Houston project did not bee, in until the summer of 1979. 
It was a single Jr 4 High pro ct. 
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SOCIAL SERVICES (S.S.) 



Counseling ~ in s.s., AIR evaluates CIS 1 ability in 
coordination of primarily "hard" social services. 
AIR has said, "... delivery of social services as 
traditionally defined (e.g. housing, welfare 
assistance,- professional counseling, leqal advice, 
medical assistance) was a small part of 'the CIS 
operation." We stronqly disagree with the 
implication of that statement, The evaluation 
separates out most CIS counseling services as not 
professionally administered, i.e. - not provided hv 
a licensed therapist/profesional counselor. We 
feel that most of the discreoancv AIR notes between 
their assessment of services delivered and our 
assessment of services delivered occurs because of 
this difference of opinion. CIS is not a fc 
traditional service system, and we don't define 
ourselves in traditional terms, ^e utilize staff 
from the traditional organizations and bv 
coordinating their resources provide a better 
oroduct. AIR does not compare us to existing 
resources to show whether our program services youth 
and families better than each cooperating singular 
organization does. And, thev summarily dismiss the 
efficacy of general counseling by an eclectic staff 
as a notable service delivery. 

How many youth, in a normal situation, see and talk 
with a caseworker from any agency on a daily basis? 
How many youth in the existinq social service 
structure, receive counseling based on needs assessed 
by a qroup of caseworkers from various disciplines 
combininq their expertise? 

Oranted, CIS has had many staff who were not agency 
seconded and who did not have a great deal of 
experience. But, there were few, if anv, CIS Family 
qroups which did not have at least one or two 
experienced social service staff to provide informal 
quidance to the inexperienced Family caseworkers. 

As can be seen in Table 2, the levels of CIS 
non-professional counseling services provided were 
verv, very hiqh. They averaged about one per case- 4 
load student per week, as long as they remained in 
CIS. Not counted are the numerous counseling services 
provided to former participants to provide support 
when they return to the regular school program, or 
graduate, or even after they drop out. Maintaining 
a supportive relationship with a dropout sometimes re- 
sults in CIS staff getting a student back in school. 



ERIC 



A- 5 

123 



Table 2 
Counseling Services Provided 





N 


1978-79 


N 


1979-80 




Atlanta 


1,206 


27,900 


1,160 


38,144 




Indianapolis 


1,514 


33,228 


923 


• 25,844 


(1) 


New York 


395 


14,400 


215 


4,134 


(2) 


Houston 


_ (3) 




89 


3,158 




Oakland 


115< 4 > 


2,448 


159 


2,7.10 




Washington, D,C. 


131 < 5 > 


948 


160 


4,892 





( 15 Entire school system was closed until end of 
October for teachers' strike. Two CIS projects 
were closed. 

(2) 

Only data for Julia Richman project were available. 
Project opened in 6/79. 
Project opened in 12/78. 
Project opened in 2/79. 



A convincing argument we advance for including counsel- 
ing as a social service is that even when services to 
youth have been provided to correct all the physical 
tangible problems, (i.e. housing, medical, legal, and 
welfare) if that youth's attitude, self concept, and 
values remain the same those tangible social services 
most likely won't, result in measurable improvement. 

a f D^hifm Ud r^ K° 6S n0t rec °9nize his/her hostility as 

thll 5 e/She 18 nGt likel y to work on changing 

that attitude to one of cooperation and trust. 

r^s 0n or i ^,I amil ? gr ° UP meetin 9 s ' informal one-on-one 
raps or whatever form m which counseling contact 

i?ud££ ' Xt 13 t0 P° sitive change in the 
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Defining Measu rable Parameters of Social Services - 
included disagreement with AIR on the S.S. status of 
programmatics and educational services as well as 
general counseling. We think AlR's boundaries were 
much more narrowly defined that were CIS' in deter- 
mining what, exactly constituted specific S.S. needs. 
There seemed to be agreement on written terminology, 
but when it was applied to categorising caselog 
entries we differed sharply. On page 63 of the Report, 
AIR reports on a two-year analysis of 3 9 caseload 
student files; they * identify 45 services delivered. 
In Table 3 CIS staff counted over one thousand services 
after going through only 12 of the same 39 files. 



Table 3 

Social Services 
1978-79 and 1979-80 School Years 
12 CIS Caselog ZLles 



Type of Service 
Provided 



Transportation 
Home Visits 

Attendance Monitoring and 
Counseling 

Academic Performance 

Monitoring & Counseling 

Career De velopment and Job 
Placement Efforts 

Probation Monitoring and 
Legal Advocacy 

Counseling on Negative Behavior 

Referrals for Psychotherapy 

Counseling on Inter-Family 
Relationships 

Counseling on Peer Relation- 
ships 

Counseling on Motivation and 

Improvement in Self-Concept 
Physical Assessments 
Medical Treatment 
Dental Treatment 
Glasses 

Family Planning 

AFDC 



Frequency of 
Provision 



96 
131 

399 

93 

29 

9 
62 
2 

24 

12 

70 

6 
17 
10 
8 
4 
4 
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Food Stamps 

Title XX Eligibility 

Other Public Assistance 

Housing 

Clothing 

Food 

Day Care 

Parental Involvement 
Group Cultural -Activities 
Group Educational Activities 



1 
18 
3 
1 
8 
2 
2 
25 
36 
46 



TOTAL 



1,118 



The purposes of S.S. in CIS projects are: 

1) to impact students 1 attendance and school 
performance; 

2) to impact students' behavior at school) with 
peers , and with family; 

3) to deliver health services, both preventive 
and treatment; 

4) to provide enrichment experiences; 

5) to assist in job placements and job readiness 
training; 

6) to provide legal advocacy and probation 
monitoring; 

7) to involve parents in their children's progress; 

8) to meet emergency needs, i.e. housing, clothing, 
food; 

9) to assist students and their families in^obtain- 
ing public benefits which they may need; 

10) to do all of the above in the context of a 

personal, trusting relationship with the student* 

A relationship has to be established with the student 
that includes good communication. A student must have 
a reasonable attendance record to take advantage of 
the resources of the project* While school attendance 
is not an end in itself, for many students attending 
school regularly is a first step in taking responsi- 
bility for their lives. Attendance and academic 
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monitoring, dealing with behavior problems , interven- 
ing in suspensions and preventing expulsions are basic 
functions that project staff must perform is the high- 
risk student is to remain in school. 

The information on the past two pages are included for 
two reasons: First , to establish the fact that 
students in CIS require an intense level of service 
if they are to grow to self sufficiency. Table 3 
shows that such intensity of effort is being provided 
by CIS. Second , the AIR report downplays the import- 
ance of much of this activity, and the levels at which 
they are reported. Many of the services fall into the 
categories of educational services, counseling, and 
enrichment activities. These are and must continue to 
be major service areas. 

CIS believes it is this failure by AIR to acknowledge 
the importance we place on non-traditional Social 
Services which has resulted in our widely different 
interpretations of the data. 

While AIR*s interpretation does not validate our hypo- 
thesis, neither does it ^nder it invalid. We agree 
that the results are inc elusive. CIS will not belie 
its claim for the efficacy of its model until or unless 
proof is shown. 



ATTENDANCE 



Attendance, as discussed in the Report, focuses on only 
those students followed longitudinally for two years. 
In fact, the "n's* reported in tables throughout the 
evaluation reflect just this group. We would like to 
clarify the fact that total enrollment in CIS was con- 
siderably higher, and that attendance for the overall 
groups showed positive trends. Table 4 shows the total 
enrollment in CIS projects during 13/8-79 and 1979-80. 
Even in the three projects AIR studies, while attrition 
truncated their sample, the projects themselves main- 
tained their enrollment at desired levels by entering 
new students when others left. 
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Table 4 

CIS Enrollment - All Projects 





# of 
Sites 


1978-79 


# of 
Sites 


1979-80 


Atlanta 


7 


1,206 


7 


1,160 


Indianapolis 


7 


1514 


4 


J J 


New York 


3 


395 


3 


388 


Houston 






1 


89 


Oakland 


1 


115 


1 


159 


Washington, B.C. 


1 


131 


1 


160 



Ta?]; 6 *- shows the P erce nt of attendance, by city, for 
1^79 and 1979-80. As can be seen, unmatched; over- 
all attendance increased in every city but Indianapoli 
The drop m Indianapolis corresponded to a city-wide 
decrease in student attendance attributed to the eight 
week teachers* strike. y 



Table 5 

CIS Attendance - All Projects 





1978-79 


1979-80 


Atlanta 


78.9 


79.3 


Indianapolis 


85.2 


78.6 


New York 


71.3 


11. A 


Houston 


mm 


86.3 


Oakland 


67,0 


78.2 


Washington, D.C. 


66.2 


80.0 
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But, an additional view is more important — that is 
looking at and comparing data on a student by student 
rather than on a group average basis* 

In reviewing Atlanta attendance data^for tfeSse students 
m the Smith project for the full two yeara evaluated 
by AIR, we discovered that one-half of this- group's 
percent of attendance increased and one-half- decreased 
from 1978-79 to 1979-80. The combined data f'or this 
group shows an increase from 79.9% to 81.2% attendance. 

Attendance data for the students in this group who were 
retained for the 1980-81 school year (third year in 
CIS) were also reviewed. For the first quarter of 
1980-81, tvo-thirds of the group remaining improved 
their attendance over the pr\or year. 

There were 130 students in the Smith project during the 
197 9-80 school year. Fifty-six of them increased their 
percent of attendance compared to 1978-79. 

The above data show that comparing data on a by-studenr 
basis provides a clearer picture of the project's im- 
pact in some cases than does averaging data for the 
group as a whole. We think we have shown that CIS has 
been successful in stabilizing or improving attendance 
with a significant number of students. 



BASELINE BUDGET - RELATIVE PROGRAM COSTS 

We would like to emphasise that at this time and in 
the future we would not start a project, or encourage 
anyone else to do so with "bought" staff. Caseload 
staff should be at a level determined by agency com- 
mitment and availability of thair existing personnel 
to be outstationed as caseworkers (institutionaliza- 
tion) , and as determined by the desired project size. 
The AIR projections on page 84 of the Report do not 
reflect what we would recommend in division of proj- 
ect costs: caseworkers would be paid for by their 
home-base agencies, and teachers would be paid for 
by the host school system; school personnel and most 
overhead would be in-kind contributions; only some 
administrative, activities, and materials costs would 
be direct financial responsibilities of CIS. This 
relieves a tremendous burden on the new projects in 
fundraising activities. 
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CIS is actually now at about a second of three stages . 
in its development of financial costing. In the 
first stage , projects were formed in a city and most 
if not all staff and other costs were raised by CIS 
from Federal, state, and .other sources. In the second 
stage, which is where most of the projects are now/ . 
CIS meets with city officials from agencies, the school 
system, and local government and business to deter- 1 
mine level of potential support. The involved organ- 
izations "buy into" CIS, determining the extent of com- 
mitment and types of in-kind they can mobilize. The , 
project starts with the number of staff which cigenci^s* 
and the schools provide to it. Some costs are picked ^ 
up by CIS through Education Department funding or other 
sources. Technical assistance and coordination is 
provided by the national office, CIS, Inc. In the 
third stage , cities will take the initial steps in 
developing their CIS project. The national office will 
provide the standardized model and whatever technical 
assistance is necessary or requested. All funding will 
be arranged and coordinated by the city itself. A 
local policy group will bear the responsibility of 
running the project for their own city. 

When AIR sets a figure of perhaps $180a to $2200 per 
year per student for CI&, they fai4 to address the most 
important and largely unanswered questions that are 
posed : 

What would it cost to provide all the services 
CIS provides, particularly the daily contact, 
if e^ch agency had to provide it at this level 
to a comparable numbet of youth, using their 
own staff* and facilities? 

- What long-range impact may CIS be having on — 

- welfare costs (education = jobs} 

- birth defects (prenatal care =- well babies) 

- crime rates (values £ pride - good citizens) 

- unemployment (career development - jobs)? 

- Or asked another way; If CIS can provide pre- 
natal care and nutrition information chat saves 
one unborn child each year from developing perm- 
anent birth defects caused by his adolescent 
mother # s use of d^ugs or poor diet, what*w>uld 
be the estimated long-range, lifetime savings 

to the existing social services? 
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- It is sometimes necessary to look at what the 
benefits to only one individual might be, to 
put an overall value on the model as a whole. 

- The human value cannot be calculated. CIS re- 
serves the right to operate humanistically, 
within an economically feasible model. 



A lot has been said about institutionalization. In 
CIS, institutionalization is that process which re- 
sults in caseload staff — caseworkers — being outsta- 
tioned by their agencies at no cost to CIS, to work 
at a school-based CIS project site. AIR reports the 
concept faithfully — 

- potential agency savings 

- coordination of services 

- personal ism 

- skill-sharing 

They seem to conclude, however, that because of a 
number of reasons — 

- bureaucratic paranoia 

- inexperienced and/^r unqualified staff 
assignments 

- lack of job security and benefits 

institutionalization should not be a priority concern 
or a part of the CIS standardization model. We strongly 
iiFagree with that conclusion. Coordination of services 
delivered by experienced staff could be bought if .the 
funds were made available, but that: 

- is becoming ever more difficult given the 
existing economic climate. 

- totally defeats the concept of the cities being 
in the schools (CIS), when city governments and 
local agencies buy into Cities in Schools by 
agreeing to outstation existing staff, in effect 
restructuring their service delivery system, 
then they have internalized" the program as a 



INSTITUTIONALIZATION 
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part of their city. We think that this is the 
only way the program can survive and fulfill 
its potential. 

Just because it hasn't always worked in the projects 
at the level desired is not conclusive evidence that 
the idea should be abandoned. Rather, we think that 
in the past two years we have proven it does work, 
particularly as seen currently in the Houston and New 
York projects. 

- In Houston , all but the five administrative staff are 
outstationed (25 experienced social service staff) 
from agencies such as Big Brothers/Big Sisters, Boy 
Scouts, Harris County child Welfare, Community Youth 
Service, Harris County Department of Education, Houston 
Department of Parks and Recreation, Hispanic Interna- 
tional University, etc. 

~ IB New York there are over 40 staff outstationed from 
such city ajencies as the New York City Youth Board, 
Human Resources Administration, Department of Social 
Services, New York City Board of Education, Department 
of Parks and Recreation, and from such private agen- 
cies as United Families, Catholic Charities, Inter- 
faith Neighbors, Inc., Columbia University Teachers 
College, etc 

- In Indianapolis a CIS Policy Group was created in May 
or iy/9. CIS had gone to the Indianapolis Corporate 
Community Council to ask for support for the program. 
The Corporate Community Council responded by helpina 
to develop a policy group for the program. J 



The Pol id/ Group has accepted responsibility for ident- 
ifying arid garnering resources, monitoring program re- 
sults, and replication of the program. The members are 
-rom organizations which are influential in their areas 



throughout the city/state. It is the vehicle by 
which Tndianapolis CIS will move into the third stage 
ot the institutionalization process— the city takinq 
ownersmp of the program. Policy Group members include: 
Director, Near Eastside Multi-Service Center, Executive 
Director to the Governor, Special Assistant to U.S. Sen- 
ator Richard Lugar, Vice Pres. of Indianapolis Power and 
Light, Board Chairman of Merchants National Bank, Vice 
Pres. of Tndpls. Chamber of Commerce, Superintendent of 
Indianapolis Public Schools; President of American 
Fletcher Vnti mal Bank; Board Chairman of Indianapolis 
Water Co.; E:-.ecutive Director of Community Service 
Council - I'm*::.! Uavj president of Indiana National Bank 
P esident o« Indiana Bell Telephone; Vice-President of 
Midwest \atio\-J 2ar.k; Special Assistant to Senator 
Bir-h r'rv-n; th Deputy Mayor cf Indianapolis. 
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AIR modified its research design during the course of the 
three year evaluation in several ways. Because of the large 
numbers of students and the vast amount of statistical data 
to be compiled and analyzed it was decided to follow for two 
years only those students who were enrolled in CIS at 
Arsenal Tech, Smith and Julia Richman High Schools in the 
fall of 1978. All other existing CIS sites, students, and 
new students entering the three projects studies were ex- 
cluded from the analysis. 

Even with the^mgdif ications, which were dictated primarily 
by financial Constraints, the basic variables to be evaluated 
remained constant. Yet the program AIR evaluated at three 
sites was not really representative of CIS as it existed. 
Other than basic descriptive information, threje CIS new 
projects which began after the AIR study started were not 
studied, and fourteen existing project sites in Atlanta, 
Indianapolis and New York were also excluded. The following 
two sections give some current information on the status of 
these "unknown soldiers. 11 

2. New Programs or Projects not Evaluated by AIR 



89 caseload students 
284 non-caseload students 
373 total youth served 

- 55% were in families receiving public assistance. 

- Average attendance for the project was 8 6.3%. 

- Over 3,800 social services were provided. 

- 15 public and private agencies had outstationed staff 

* More than 40 organizations and individuals provided 
financial support or other services and resources/ 



HOUSTON 



1979*80 



- one project at M.C. Williams Jr. High School 
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1980-81 (Sept, - Dec.) 

- three project sites: M.C. Williams Jr. high, Wesley 

Elementary, Marshall Middle 

- 193 caseload students are being served. 

- Average Attendance for the three projects is 83.4%. 

- Over 4,700 social services have been provided. 

- More than 79 special recreational, cultural, and 
educational activities have been arranged for students 

OAKLAND 

19 79- 80 

- one project at Hamilton Jr. High School 

81 caseload students 
389 non-caseldad students 
4 70 total youth served 

- 44% were in families receiving public assistance. 

- Over 2,300 social services were provided, 

- Nine public and private agencies had outstationed 
staff. 

- More than 110 organizations and individuals provided 
financial support or other services and resources. 

1980- 81 (Sept. - Dec.) 

- Three project sites* Malrose Elementary, Hamilton 

Jr. High, and Fremont High 

- 16 6 caseload students are beinj served. 

- Average attendance for the three prpjects is 86.3%. 

- Over 2,2 00 social services have been provided. 

- Mora than 277 special recreational, cultural, and 
educational activities have been arranged for students. 
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WASHINGTON, D.C. 

1979-80 

- one project at Terrell Jr. High School 

160 caseload students 
1 ,198 non-caseload students 
1/358 total youth served 

- 70% were in families receiving public assistance. 

- Average attendance for the project was 80%. 

- Over 6,900 social services were provided. 

- One agency had outstationed eight staff. 

- More than 50 organizations and individuals provided 
financial support or other services and resources. 

1980-81 (Sept. - pec.) 

- one project site: Terrell Jr. High School 

- 138 caseload students are being served. 

- Average attendance is 81.5% 

- Over 4,200 social services have been provided.' 

- More than 96 special recreational, cultural, and 
educational activities have been arranged for studen 



Existing Projects not Evaluated by AIR 

IN ATLANTA 

Craddock Elementary School 

Carver High School 

Atlanta Street Academy "A" 

Atlanta Street Academy "B" 

Atlanta Street Academy "T" 

* St. Luke's Area III Learning Center 



St. Luke's is a unique street academy sponsored 
jointly by St. Luke's Episcopal Church (building, 
maintenance, utilities and volunteer tutors) , 
Atlanta Public Schools (teachers, educational 
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materials, and educational resources}, and Cities 
in Schools (administrative staff) . 



- 14 public and private agencies had outstationed 
staff. 

- In 1979-80, more than 400 special recreational 

and cultural activities were arranged for students . 

- In 1978-79, 55 CIS students graduated form high 
school or received a G.E.D. In 1979-80, 74 students 
achieved this distinction. 

- In 1978-80, mere than 95 organizations and indi- 
duals provided financial support or other services 
and resources. 



1980-81 (Sept. - D ec^ 

- Six project sites: Carver High, Craddock Elementary, 

Academy "B", Academy *T H , Smith, 
St. Luke's. Academy "A" closed 
because of funding cutbacks. 

- 726 caseload students are being served. 

- Average attendance for five of the projects is 84.1%. 
(Attendance has not been computed for the elementary 
project. ) 

- Over 7,600 social services have been provided. 

- More than 178 special recreational and cultural 
activities have been arranged for students. 

- More than 416 tutoring juid special education acti- 
vities have been arranged for students. 



IN INDIANAPOLIS 

1978-79 - Six other Project Sites : 

Elementary School #45 
Jr. High School #26 
Jr. High School #101 
Arlington Sr. High School 
Attucks Sr. High School 
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Indy Prep 

And approximately ; 800 other caseload students in 
Flan A am Plan B^at Arsenal Tech High School. 

1979-80 * three other Project Sites: 

Elementary School #4 5 
Jr. High School #26 
Indy Prep 

And approximately 600 other students in Plan A 

* and Plan B at Arsenal Tech High School. 

* Three projects were closed because of £ui(ding 
constraints. 

- Five public and private agencies had outstationed 
24 staff. 

- More than 75 organizations and individuals provided 
financial support or other services and resources. 

- Reading scores for Tech Plan A freshmen students 
increased 2.1 grade levels. 



IN NEW YORK 



1978-7$ - 3 sites in addition to Julia Richman 

I.S. 22 - Jr. High School 
P.S. 180 -" Elementary School 
P.S. 125 - Elementary School 

- 13 public and private agencies had outstationed 
staff. 



1979-80 * Two sites in addition to Julia Richman. 

I.S. 22 - Jr. High Scnool 
P.S. 53 - Elementary School 

- 193 caseload students 

374 non-caseload students 
467 total students served. 

- 11 public and private agencies had outstationed 
staff. 

- More than 3,, 600 social services were provided. 
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1980-81 (Sept. - Dec.) 

- Five project sites: Julia Richman High, I.S. 22, 

P.S. 53, P%s. 101, I.S. 117. 
P.S. 101 and I.S. 117 are 
very new, have only one staff 
a piece. 

- 461 caseload students are reported being served 
in three sites. P.S. 101 and I.S. 117 have not 
yet reported data. 

- Average attendance for three of the projects is 76%, 

- Over 6,700 social services have been provided. 

- More than 113 special r^-creational and cultural 
activities have been arranged for students. 

- More than 65 tutoring and special education 
activities have been arranged for students. 

- 11 public and private agencies have outstationed 
staff. 

- All but one staff person at Julia Richman is 
institutionalized. 

B. Conclusions 

^nL fc ?n Pf s £ three years, CIS has made significant improve- 
ments in staff development, development and use of the 
Management Information System (MIS) as a program assessment 

izltion If 3£ ??c i0n , a ? d inte 5 nal evaluation, and standard- 
ization of the CIS model. We have also benefitted from 

Directors? 5 ™ 6111 ' ° f * Strong and effective National Board of 

And, not to belittle the concerns we have expressed, we 
found we agreed with AIR on several issues. The most nota- 
oie are: 

1. AIR says there have been problems with the quality of 
CIS caseworkers. 

a. CIS agrees that because of funding constraints and 
because of agency assignments, many of the case- 
workers are not what AIR defines as professionals, 
and some do not have the skills which fit the 
tasks to be accomplished. 
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b. CIS responses to the need to strengthen the case- 
„ worker capabilities have included — 

(1) Extensive work to get existing service 
agencies to deploy experienced staff to 
the CIS projects, where this has occurred, 
better results have been shown. 

(2) Obtaining grants for the national CIS office 
which will enable the provision of technical 
assistance, including staff development and 
training, to each CIS city. 

(3) Development of comprehensive one-year and five 
year plans, which identify staffing and budget 
ing priorities. 

(4) Strategy meetings with human service agency 
directors in Houston, Atlanta, and Oakland, 
to plan future institutionalization of case- 
worker staff. Meetings in the other cities 
are planned in the very near future. 

c. In the future, CIS plans to continue to work for— 

(1) Adequate funding to hire experienced and 
qualified staff. 

f 

(2) Development of a set of appropriate criteria 
against which prospective staff could be 
measured. 

(3) Development of a comprehensive training and 
assessment program for existing staff. 

(4) Negotiating with agencies to — 

Assign experienced and resourceful staff 
to CIS; staff whose backgrounds meet our 
criteria. 

Institutionali2e those staff, so that their 
funding is not in jeopardy each year. This 
would have a stabilizing effect on the over- 
all program. 

AIR states that unstable, fragmented funding has had a 
number of negative effects on CIS. 



a. CIS agrees that the funding problems have had 
negative effects such as — 



(1) Not getting or keeping the quality of case- 
workers needed* 

(2) Inability to stabilize casoloads/program 
structure. 

(3) Unwillingness of agencies to participate in 
CIS, much less institutionalize staff. 



(4) 
(5) 
(6) 



Damaging CIS' credibility with schools, com- 
munity, city, agencies, other funding sources. 

Lowering staff morale; i.e. "Where, and when, 
is my next paycheck coming?" 

Requiring extensive, duplicative paperwork, 
and overlapping reporting and evaluation re- 
quirements. 



b. CIS responses to the need to stabilize funding have 
included — 

V 

(1) Development of an organizational five-year 
plan, which includes a priority for affecting 
policies and legislation on funding and fund* 
ing patterns at federal, state, and local 
(county, city) levels. 

(2) Much work, already accomplished in getting 
agencies to outstation their staff to CIS, 
with agency funding. 

AIR has said that CIS needs to improve its management. 

CIS has responded to this need by — 

(1) Hiring, in Fall, 1979, an Executive Vice 
President charged with developing and imple- 
menting a comprehensive management system. 

(2) Moving to standardize goals, objectives, and 
basic program structure, 

(3) Refining and implementing a Management Inform- 
ation System (MIS) which is reported monthly, 
and used in program management and planning, 

(4) airing a comptroller to standardize and con- 
solidate all financial records and reporting, 
and to set fiscrl policy and practices. 
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4. AIR has said Cities in Schools has too many agendas; 
the goals are overly ambitious. 

CIS has moved to correct this weakness by — 

(1) Standardizing the operating model, and the 
goals and objectives. 

(2) Holding an education conference in November, 
1980, with nationally recognized educational 
leaders and innovators as presenters, to ex- 
plore CIS's role in the educational arena. 

(3) Implementing regularly scheduled management 
meetings between city directors and national 
staff. 7 



(4) 



staff. 

. . / 
Utilizing the services of the Support ,'center 
to assist in developing the five-year >and one- 
year plans, for each city and for the national 
office. 

(5) Obtaining grants to provide technical assist- 
ance to each local city and for the national 
office. 

(6) Greatly decreasing the private debt incurred 
while originally developing and demonstrating 
the program. 

(7) Elicitng greater involvement of the National 
Board of Directors (and local Policy Committees) 
in monitoring fiscal and programmatic controls, 
and assisting in fundraising. 



****** 



Finally, CIS staff would like to express thanks to the in- 
valuable input received from Norman Gold, the NIE project 
officer for this evaluation. V 

Our infant, CIS, is on its feet — indeed has passed quickly 
through childhood. The real race CIS is in has no discern- 
able finish ; -H.ne, no cheering crowd at the end. Yet the 
outcome is critical for our nation— a workable model with 
which cities can prevent the loss of thousands of productive 
citizens to generations of poverty and dependency. 
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Appendix B. 
Design of the Study 



On October 19, 1977, the American Institutes for Research 
(AIR) began the evaluation of the Cities in Schools Program. 
Data collection for the evaluation ended in the summer of 
1980. The final report was submitted ir> February 1981. 



STAFF 

The evaluation was conducted by AIR* s Institute for 
Neighborhood Initiatives, directed by w. Victor Rouse. The 
evaluation's Project Director and Principal Investigator was 
Charles A. Murray. Associate Project Directors and other 
senior staff • of the evaluation over the cjourse of the three 
and one-half years were: Blair B* Bourqvje, D. Rigney Hill, 
Robert E. Krug, Saundra R. Murray, Dian Overbey, Janice 
Redish, and Jane Schubert. Support for data collection, 
data analysis, and report preparation was provided 1 by Pamela 
Belluomini, Joan Botts, Louis Cox, Joan Flood, Wilfred H*mm, 
Ronald Harnar, Shirley^jHines , Cindy Israel, Eileen Kelly, \ 
Karol Kerns, Helen McKenzie, Mary Martin, Denise Peck, Anita 
Bennett, and Ellen Stotsky, The principal on-site data 
collectors for the evaluation were Dian Foley, (New York) , \ 
Juanita Harris (Atlanta), and Toni Simons (Indianapolis). 



DATA COLLECTION PROCEDURES 

*- 

\ Three types of data were collected: interview, 

., archival, and observational. We describe each in turn.' 



Interview Data > 

Interviews were conducted with (1) CIS staff (Case 
workers and* administrative staff), (2) the students in CIS, 
(3) other stqdfents in the same schools, (4) school staff 
(teachers and^admini strati /e) , (5) social service agency 
staff, and (6) local business and political leaders associated 
with the program. The interview data sometimes concerned 
individual students (as in the interviews conducted with CIS 
Caseworkers and sf-udents) , and sometimes impressions and 
observations of the program as a whole (the interviews with 
teachers, CIS administrative staff, the social service 
agency staff, and business and political figures). 



ERIC 



148 



CIS Caseworkers . The basic sampling principle W db to 
obtain triangulated information (CIS, student, archival) on 
a 30 percent sample of all CIS students. The 30 percent 
figure was governed primarily by the practical limits to the 
demands we could place on Caseworkers: Given a ten-student 

ioaa, we interviewed each Caseworker concerning three . 

students during the fall pretest and spring posttest. This 
represented about two hours of interviewing during each 
round. Topics in the interview focused on school achievement, 
school behavior, out-of-school behavioral or environmental 
problems, interactions with the Caseworker, participation in 
CIS activities, and overall student responses to the program. 
The instrument is shown in Exhibit B.l. 

Discussions with CIS administrative staff were not 
limited to a single protocol. The form shown in Exhibit B.2 
was used for purposes of data collection on outsta tioning . 
Other interactions varied from a few informal interviews on 
the program to regular extended discussions of a wide ranqe 
of topics. 

CIS students . The student interview protocol covered 
the topics addressed in the Caseworker form. The instrument 
is shown in Exhibit B.3. 

Other students in the same schools . These interviews 
were conducted as part of data collection for a nonequivalent 
comparison group, to be used as a supplement to the analysis 
of CIS effects on the students. Because of severe self- 
selection problems (very few parents would return the 
mandatory parental permission forms) , these data were of 
little use. 

School staff . Interviews were conducted with 25 
randomly selected teachers not assigned to CIS. The inter- 
view items called for open-ended responses to items about 
the program in general, as shown in Exhibit B.4. Additional 
interviews were conducted with the principals in the schools 
where CIS is active, most of the assistant principals, and 
senior members of the school system administration (see 
Exhibit B.5, described below). 

tu Social service agency staff. We attempted to interview 
the head of each agency that maintained a relationship with 
CIS. The instrument shown in Exhibit B.5 was used for this 
purpose. In addition, CIS Caseworkers who had previous 
experience with another social service organization other 
than CIS were interviewed using the instrument shown in 
Exhibit B.6, to obtain comparisons between the working 
environment in CIS and in traditional service delivery 
formations. 
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Political and business leaders . The interviewees. 
% varied by city, depending on the contacts that the program 
Hfad established. When the respondent represented an aff&o- 
'ization with a direct link to CIS, the instrument in - */' •* 
Exhibit B.5 was used. In addition, open-ended narrative " 
interviews were conducted in which the respondent was 
asked to recount the history of his interaction with the 
program, with follow-up questions as necessary about 
the respondent's assessment of the program, prognosis for 
the future, and suggestions for improvements. 

CIS and school staff and political leaders . Several 
people who had played a major role in developing the program 
at each site" were interviewed to obtain historical data. 
The interview guide is shown in Exhibit B.7. 



The "Intensive" Sample 

Midway through the evaluation, it was decided that 
additional data should be collected about a subsample of 
students, to permit a more detailed, triangulated case 
history approach. In addition to the standard data collec- 
tion, members of this subsample were to be given additional 
narrative-response items in the fall and spring interviews. 
A third, entirely narrative,- interview was conducted in the 
middle of the year. The sample procedure was followed for 
Caseworkers associated with these students. Parents were 
interviewed, as well as a teacher designated by the student. 
The subsample was called the "intensive" sample. 

A total of 25 students were included in the. intensive 
sample: 5 from Atlanta, 10 from Indianapolis, and 10 from 
New York City. Because the purpose of the intensive sample 
was to maximize our diagnostic information about CIS, a 
random sample was deemed inappropriate. Rather, we ex- 
plicitly asked Caseworkers and administrators in CIS to 
nominate those students who (1) provided examples of CIS 
participants with high need for CIS, and (2) provided 
examples of an active CIS intervention. 

Material from the intensive interviews was written in 
narrative form. For purposes of analysis, the main points 
were abstracted onto a face sheet. A page of guidelines was 
prepared for the interviewer, to be used for both the- student 
and Caseworker interviews for the intensive sample. The 
guidelines had four sections. 

Section 1 was an assessment of student and family 
needs. Subtopics were a description of the student, descrip- 
tions of the family members, description of the student's' 
friends, description of the neighborhood, a review of the 
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school record and the student's attitudes about school 
(attendance, grades , ^behavior , relationships with teachers, 
needed^Iinpro^ment" 1 "" - U, ^' s understanding of areas that 

with Clt Se ?Zt Section concerned the students' interaction 
ptc k Subtopics were a description of the activities 

CIS has provrded, the students' attendance at those activities 
' ' P ^ hGlr f a ff ssment - of the value of the activities, a dis- 
rol-i relationship with the Caseworke and with CIS 

ceachcrs, an assessment of what the program is good for, and 
thea.r opinion of CIS classes. y ' ana 

K The ^4 rd section ask ed the student to identify the 

Thtt ? r £ StUdent kneW the best °r liked tie best 

That teacher was subsequently interviewed as part of the* 
intensive sample data collection. 

The fourth section dealt with the interviewer's observa- 
tions about the student: attitude, dress, demeanor abmtv 
to communicate, and other characteristics that wSuld not 
come across m the written record of the student's Responses. 

Archival L.^a 

The archival data collection, like the interview sched- 
ules, oroke roughly into halves; A oeneral acquisition of 
program documentation, dealing with the histor? and admini- 

ffiSc!a^tS2?r' ^ SearCheS ^ ^eaUng 

The three maxn sources of arch^'a"* d-if* rm fh 0 ^ ^ ^ 
were the school fixes, the CIS pro £ , °poUoe rocord' 
(in Indianapolis), and court records (in J'I^m „. 
police and court histories of ?IS scudents"coula not fe 3 °" 
obtained from New York because of loral <n-*^t ■ 

confidentiality. The for^s usef to record tt'se latTere" 
shown in Exhibit u " se aata are 

Observational Data 

staff Th Hnr^n ee f° n T^ te uf^ Collectors ^nd Washington 
staff, during field-work) had extensive Opportunity to 
observe the program. These included observation of CIS 
classes, tutorna spec,™, = ^=ivduon or Lib 

sessions, home visits staffin conferences, counseling 

personnel, poUcy meetincjs of Family 
of the CIS Policy ^o^^T^^^^ 

observations; the tvpes of events that Ire 'V-™^ the 

^ uvtnis tnat are most important to 
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an assessment of the program are relatively c*re and not 
amenable to observation during a specif ied^time period. A 
form was provided for recording observational material 
(Exhibit B.9) . * 



Comparison Groups 

The evaluation did not have access to natural compar- 
ison groups. In all sites, the participants were selected 
in ways that made the CIS population unique to that school. 

The closest approximation to a comparison group was 
obtained for the 1978-79 school year, at Arsenal Tech. In- 
coming ninth-graders were classified as "eligible" for CIS 
on the basis of explicit criteria based on eighth-grade 
attendance and reading scores. A member of the evaluation 
team (C. Murray) randomly assigned names to CIS and com- 
parison populations. But a criterion for funding support 
for CIS was eligibility for Title XX funds, and the size of 
the CIS program at Tech meant that nearly all Title XX- 
eligible students had to be assigned to CIS. The result was 
substantial shifting of the randomly assigned populations, 
eind the CIS population was not comparable to the comparison 
group on a presumptively important dimension: poverty. 

At all sites, attempts to obtain comparison data were 
also frustrated by Federal regulations involving parental 
consent. Parents of CIS participants signed consent forms 
as part of the process of entering the program. But return 
rates of consent forms for non-CIS parents were extremely 
low (on the order of. 20-30 percent), and follow-ups still 
left such a high non-return rate that the self-selection 
biases were great. In view of the acknowledged uniqueness- 
of the CIS population, it was decided that greater expendi- 
ture of resources to obtain interview data would ba uniutt- 
lfied. J \ 

Grade and attendance comparison data were nonetheless 
obtained for non-CIS students at all sites. Ex post facto 
procedures were employed to draw what inf erenc¥s^e~ C ould , 
focusing on the non-CIS students whose pre-ninth grade 
records were similar to those of the CIS students. In all 
cases, we tried to word the conclusions precisely, with 
emphasis on the limiting characteristics of the comparisons 
at each site. 



Samples 



Table B.l on the following page summarizes the samples 
for data related to specific students (ignoring respondents 

who discussed the program in general) . ponaents 
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TABLE 8 1 




STRUCTURED CASEWORKER INURVJEWS 

& IRS" ST" « sg. g-d-* 



31 22 15 It i9 
NA NA NA NA NA NA 



117 132 99 49 43 
NA NA NA NA NA NA 



UNSTRUCTURED INFfNSJVEiNTfRvieWS ; ^* S * !=- ~ 
^ '878/9 1979-80 

gg* t ^ ssl rMdWf 



10 10 



NOWtCri STRfCK LAND 
IMffRNAl fJfTfRNAL LOCUS OF CON! ROL 



arch iv At record sfarcmp*; 

1978 79 197930 



10 10 



10 10 



28 3* 70 24 15 
NA NA NA NA NA 



40(5 383 271 387 242 lfi7 
25 



10 '0 10 NA 10 10 
NA 



72 
160 



90 60 50 147 57 50 



583 
130 



Ml 

to? 



34 {No »rnq« CIS) 
75 



157 

108 !No tonqw C»SJ 
130 



78 

5' I No Hinqm C*S> 
160 



153 



154 
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DATA ANALYSIS 



The discussions of specific analyses are incorporated 
into the text of the various reports. General comments 
follow. 

For quantitative analyses , standard procedures for data 
preparation and coding applied. At the end of data collection, 
and after the quantified data had been keypunched from the 
forms, all documents relating to a student were gathered in 
a single file. The set of case files that resulted were the 
primary tool for the qualitative analysis. It was found 
that, while any one source was often incomplete in its 
information, the multiple sources taken together provided an 
interpretable portrait. 

A major shift in analytic perspective took place in 
early 1980, after the data were analyzed for Report No> 3 . 
Originally, as described in the evaluation design, we had 
expected to use a regression-based approach to analyze the 
relative contributions of various components of the CIS 
"treatment." It was also intended to use regression-based 
analysis to explore the kind of student that profited most 
"from CIS, under what circumstances. - But an examination of 
the data from 1978-79 revealed that we would lack adequate 
variance in the outcome measures to permit a useful analy- 
sis. The very large numbers of "no effect" students would 
drown out the explanatory role of the variables that did 
promote a "successful" treatment. 

Therefore, it was decided to focus on a qualitative, 
diagnostic analysis. To facilitate this, Caseworkers were 
asked to provide ratings of the sample students on a few 
simple dimensions of level of economic, persbnal, academic; 
family, or "other" problems; a rating of the 1 level of inten- 
siveness of the case worker, effort; and a rating of the 
level of outcome. The AIR evaluation staff conducted 
similar ratings on the basis of materials iix the case files. 
These ratings were used with quantitative indicators such as 
changes in attendance and grades to pull files that were 
candidate examples of success and failure. These files were 
then independently reviewed by the authors of the final 
report. The qualitative discussion in Chapter 5, and quali- 
tative discussions of case worker performance in Chapter 3 
represent consensus judgments based on these reviews. 
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Th* rtoon tt authoring oy if* <20 U.S.C. 1 22)ti vou CITIES in SCHOOLS Evaluation 

•ft not reou'tc to "uoona your eoootfition 1 *! rmams xz 
trm mum o* «»* suivey c om prtf w wvt, accurate and 

-Caseworker 

fjtcwtofl Date 30 Aygwi 1380 J IntBTVISW 



A 



Form 

POST-TEST / Scnedule A 



Stuoem 10 No 
Grace 



Component 



Race 



Case Manage" 10 No. 
Sex 



Inttrvttww Notts: 



• You ere e member of en moependent evaluation tmm visning Attents. 
New York end Indianapolis. 

• We will be asking about 2 or 3 students that have been randomly 
selected from your caseload* 

• Ail answers ere strictly CONFIDENTIA L Students ere assigned 
identification numbers; names ate not recorded. 

j 

• We have i n t er vi e w e d you once about this student in the fall. 
During this interview we would like to focus upon two Questions: 

1, Whet do you see as the needs of this stuaent 
end his/her femtly? 

2 In whet way has the program helped? 



• CHARACTERISTICS OF THE STUDENT 

1. We hats selected this student at random. How typical is this student? 

Of at i the stu'oonts :n Tiy caseloac. this stuaent 



fl has had the fewest prooiems 
[I has had fewer oroPiems than most 
f| s aoout average 



B 



has nacl fiore problems Than most 
has nao trie most prooiems 



2. How dote is your relationship with this student compared to others m your caseload? 

n Goser than with at most ihv other 
stuaen: in ny casetoaa 

Closer tnan me average 

Aoout fy«raot Q Othe r ispec;fyi 



S 



Not as cose as with most o* the otne r s 

LJ, v ou oickta the stuoem i am orooaoiv 
east :tose wttn 



1 In terms of school work, how motivated is this student compered to other students 
fa hit/her trace? 



Don'* <now 
j j Does oniy enougr :s get ov 



! Crhf *scecfv) 




4. How se*f-cenf«lem is he/she tor his/har aee? 

n Don : Know 
!| verv se'fonTtaer*! 
\\ About average 
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Cries m Scnoois ev§i Jetton 
CASEWORKERS INTERVIEW ?0*M/A 



5, How irtteJiie^t do you mink he/she *? 

S Don't know 
Very intelligent 
About average 

& How watt does this student interact with other kids? 

know 



B Don't 
(5 a to 
all the 

PI Has a few good friends 



loner. By him/herself almost 
ail The time 



Below average 
Other {specify* 



BFrtenaher than average 
Needs to be arouno otner oeooie 
constantly 

PI Other tsoecify) ^ 



• INTERACTION WITH CIS PROGRAM 

7. During the LAST WEEK ONLY (last 5 school deylf, how often have you Had an extended talk 
with this student. OONT WORRY I? THE LAST WEEK WAS NOT TYPICAL; we are going 
to combine your answers with those of all the other east managers. 



j Did not talk, except to sav hello m oassing 
lOnce 

] Other i explain)- 



a 



twice 

More than twice 



# Wa* iast,*eek tvpn^al [j Yes Q no 

S. When do you usually see him/her to talk? (check all that aopiyl 

1 During regularly scheduled class 
J During special activity penod 
j ?or »noividuei appointment 

(" in the hall 
in the lunchroom 



After scnooi 
| Evening 
Weekend <* 
Otner Uoecify) 



When was the LAST TIME you saw him/her to talk (more man saying hello)? 



§ 



Dui ma regularly scheduled class 
During spaciai activity oenoc 
ror mciviouai adpomtment 
m the hall 
•n :he lunchroom 



After school 
Evening 
j Weekend 
Other isoecifv) 



• How die me meeting come about? 

• What was the tooic* | 

• What happened 



10. Which topics have you discussed with this student this year? i cr.ee k 3M that aopiv 



p 



scnooi .vor* 
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y Teacne* orooie^s 

jSt K oo* oenavfor oroo'ems 
j Attenaance at scnoo* B-8 
Qtne' isotciM 



| P'ooiems at none 
(Plans ror activities 
[Cthe' oe*sonai prooifens 
-ust talk 



^7 



11. Of the ones you mentioned which «nas you talked MOST about? (give an examo»e) 
(piace a star f df] besioe that tooic in item 101 



12. What program activities has this student participated in this year so far? 

Activity vrm * Who n*rtictpattc 7 



15: is there anything that makes it difficult for this student to participate in the program's 
after-sen oo4 actmnes? icnec* an mat aoo*y ) 



Not Known 
I No 

JHas a icd 

JneaUh pfob»e^ (soectfvi 
lOthtf tsoectfy} 



^otes 



Ch*ld -are *esocn$iOtltt\ *or rarmy 
J Transportation 

1 Parents won't aHow oartic.oatson 



• ACADEMIC 

14. Did this student need haip with any school subjects this year? *c.neck all that aooJv* 




Soc:ai stL3»es 

Er.gt'sn as a secsna ang«age 

Comoes.ron 

Scence 



15. What did CIS do for these ecaoarme problems? (cnecK an thai aoc'v; 



iDc^ ': <new 
J Not nasoed 



CIS oroviceo 

e Leammg came' 
e ^eaomg ciass 
e T.j* 0 rina aunng scnoo- 
e 7uTcr ? ng atre r scr.coi 
e Set, a> -n-ciass i§ic 



Session* or wae* ict'Cf 



4 



16. At what level u this student reading right now? 
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Don t <now 

Seacs tetter man grace *eve< 
Reaos aoout it grace lev*! 
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j 3eaa$ d#<qw graae -eve' 
I Non-reaatr 



Cities #n Senoots Evaluation* 
CASEWORKERS INTERVIEW FORM/A 



1?. V.ouid vol* ?tv t>at this students grtdw ire a reflection of his/her real «bility? 

Don't Know j [About at afritty 



□At 



the limits of his/her ability level 



Performing far betow ability 
Somewhat beiow ability 
if performing be'ow aoihty, what is the reason? (check alt that apply) 

\_ Poor anenaance * n Low motivation 

j Failure to do assigned work f| Family problems 

\ Speaics English only as second language [ |Poor teacher/student relationship 

- \ Health problem (soecify) ____ * 

Other Ispecify) 



Notes 



• SCHOOL BEHAVIOR 

A$ w* not+d tofon, a student's gmJis m*y not rwfftct hii/htr ret/ potmrtst, Sometimes 
th§ *my a student btrwvts ar school intmitrm with hts/htr Mcsdemtc performance. 



How often has this student acted this way at ad 
during the pest few months? 


tool 

HtfOIV 

Nevtr Ever 


About 
Once • 

Month 


About 
Oncta 
week 


Aimon 

Evtry 

0«V 


Don't 
Know 


Skip sen oof 


1 


i 




Cut class 












Arr«ve late fcr school 








' - ! 


Get *n trouble »n class for fooling around 


t 


I 


1 !— 1 


GeT >mc angrv arguments with staff 






\ 


Get -nto angry arguments wnn other students 




; ! • i 


Get h'gn at school 


! ' 

f 




1 | 


Get 'fttc at scnoo* 






{ 


Omer «soecifyi 







19. Of this list, which do you consider the student's moat serious problem? 



, Why' 



20. For each item that occurs "once a week" or more ask, What did you do the LAST TIME this happened/ 

Ut tttm 2nd item 3rd item 



Counse»eo siuaent maividueHv at sence* 


! ' ! 


Called stuaeni s nouse 


' 1 1 


V'$,teo student s nouse 




Wen: ou f ar senco* to fine student 


t 1 

i 


~ai*tc :c teacne' 




*aikec to Dean or othe^ school official 




D*-*e' -'SDecrv 


1 
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Cfei tn Sc^ddit gviiyatioi 
CASEWORKERS IN7E9VJEW CO&M/A 



• NON-SCHOOL PROBLEMS 

21. How about problem* that are not school -related? Do you Know about any? 

< check a^mat acpty) 



["1 Not Known 
[""I No other oroolems 
n Drug use 
P] Aiconpi use 



I""] Emotional orociems 

= amnv orcoiems 
n Oennauency 
n One- (soecfy) 



Notes 



22. How did you deal with these problems? (repeat for each -rem checked! 

1st *tem 



2r\Q item 



action 



nsei siuoent individually at scnooi 



Q Home 



visit/couhsei oarentts/ 



P"| Talk witn Oean or other scnoo* official 



Q^eferrai to other soc;a> service agenev 



Q Other tsoeefy) 



Notts: 



23. Has this student been in trouble with the police this year? iprooe for event, when, outcome, ana 
rote pi staff "nemoe r *n me situation} 



24, Net this ttudent gone to court thii year? <prooe for reason outcome, role of, anv staff memoerl 



25, Hot this student been on probotton this year? torooe for wnen, why staff role wtth probation officer) 



CONTACT WITH FAMILY 
21. Hove you visited this student s home this year? 



| No LJ Ves 



Numoer ©f T ( mes 



\ 9 
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27. What othar oomtet he*e you hid with the peremM? 



Teiecnoned parents 

| Parents teieohonea scnooi 

[ Parents came to school for group meeting 

| Parents came to school for private appointment 

I Other (specify) 



2L Betides genera* con ver sa t i o n , whet have your vtats been about? {check ail mat aooiy) 

Toic rami<y,aoout program j_J Talked to parents about student's school work 



P'iled out forms for program permission 
rilled out forms for pus/lunch tickets 
Filled out forms for income eligibility 
Filled out other forms (soectfy) 



Find out if family neeos otner services orogram 
can heio witn 



Discussed arrangements for npn-scftooi services for student 

Discussed arrangements for non-school services for another member of family 

Other (specify) 



Notes. 



29. How would you desc r ib e this student's relationship with hts/har family? 
(check all mat aooiy, tor eacn te^ eheCkeo, ask "What makes you say this?") 



Season* wftv veu »v m*$ 





Don ? know 




Parents are unusually suooortive 




No unusual characteristics, aoout average 




Parent and child are alienated 




Parent unaoie to control cnild 




Parent is negligent 




Parent is exceptionally strict 




Parent sometimes abuses cniiq 




Otner (soecify) 





30. From wMt you know of the fimti/ so far, whet art the parents* attitude toward tht program? 

icfttck Hi met aoptv i 

Don t Know 

The oarentisl does mmgs that interfere witn OS's attempts to work witn rne stucent 
The oaremls) is not *mer ested one wav or tne otner 
The parentis) approves of CIS, but does not often do mucn to help 
The parentis* actively supports wnat CIS is trying to do witn this student 
Otner (describe) 



iftv From what you know about tha femtry so far, era there any needs that remain unmet? 



B 



Housing 

| income assistance 
Emoloyment 



Don t know 
NO 

Medical c cental care 
Child can 

Mental neaitn he*, alcoholism, drug eodtcrion. otner emotional prooiemi 
Other fsoecrfy) 



Have vdu- oetn tnvoivea in trvmg to arrange aninance on these or any other services? Q Yes Q No 



f ji jescnoe 
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BEHAVIOR CHANGES 
32. 

(pro&e for examples, descriptions of each activity) 



Does this student act in the touowing ways mora than last year (or tha first few 
months of this year), leas than last year or atom tha same? 



Mora tnan 
last vmr 



law than 
iisi vtar 



About tna 
lame as 
w vmr 



a. completes school assignments 

b. pays ax tenner m class 

c. reads for pleasure - 

d> participates *n extracurricular 
activities fe g., ciu&s, teams) 

e. gets high at school 

f. makes new friends 



Don : 
Know 



©FINAL COMMENT 

33, Overall, what ts thi highest priority task ycu had In working with this student? 

suest-^r, rs not ynaerstsoa, as* ' ot ai 1 -np prooiems mat have o*en mermonec, 
/•ntcn *5 :ne oigces: one for trv$ stuaent^") 



34. in what areas did this student make tha greatest progress this year? 



38. fciiat role did C'S pity in the student's achievements? 
What tiie could have been done for him/her? 



9 
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T*i* raoon if autnomaQ &v *aW (20 U,S£. I22.ti, Wmtt vou 
art not raou<rao to 'ttpono, your coootrttton it nttdtd co 
i^Kt ffic fftdu of tfcts turvtv comorthtmrvf, aecurata, and 

umtiy. 

OM8 Form No 

€xd< ration Data X Auoutt 1980 



CITIES IN SCHOOLS EVALUATION 



y4 



Case Manager 
II* Interview 
Form 



POST-TEST/Scneduie 



Civ 



Component 



Case Manager 

Graoe 



Race 



Case Manager 10 No. 



Sex 



1. What do vou think CIS has accomplished this year? What is your 
Opinion of the program? 



2. What are some of the problems the program has encountered? 
How would yos attempt to lohte them? 



o 

ERIC 



3-24 i 6\j 



4/?B 



institutionalization questionnaire— schedule a 
project directors; c.i.s. 

1. How ware social service agency staff assigned to CIS? 



2. How was the assignment of social service agency staff coordinated 
with agencies? 



3. What kinds of problems have you encountered in coordinating this 
effort? 



4* Art there any volunteers currently working with CIS? 



Number of Volunteers 

end Af f Illation Activity Hours per Week 



5. Have you developed contacts with community' churches , merchants, or 
c onauni ty-based organisations? 



Lty^churches, 



Haas of 



riatuxe of 



Contact Organisation Contact 



Frequency 
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3Md~r-*c J 5*o.ration Oatt 30 580 1 

^or .j *jt*«*i?*a tj v >*w (20 USC t2?J»! Whitt vSy *m not rtou no 



cmes in schools svaljaticn 

Student 
Interview 
Form' 

PCSTTSST/Schtauit A 



Sruaent <C No 



Comoon*nt 
3jrrnaat§ 



.aw o* vour groucr of ! 0 



. Grace 



Sax 



Sace 



Introductory Ramariu: a 



ON CONFIDENTIALITY; we will use /£> ^m^j fnonmmal jntf vwV/ not discuss this 
conversation with anyone. Information will be assembled to report program activities and 
results, not to discus* specific individuals. 

• You ere not representing CIS. but are 9 member of an evaluaoon mam that ts *swng the 
program m the firm arks where it operates. (Describe if necessary) 

• Mar* talking to many swderfts, staff members, and parents m each of the rives to find 
> outsat me participants do and do not Him aoout the program 

• Wa are trying to learn about the program so other schools csn start programs like t*/* 

• Students are not required to answer any Questions they do not want ra As* if the student 
has any Questions before you begin 

• M are interested in their experiences during this school year only. Some Questions will 
rwrer only to the last few months. 



• SCHOOL BEHAVIOR 

1. Hov/do.you ftti about *c*oo4 in general? 



3enng 
Don't like ft 



k urv 



Wormwntje [_ I Ofcav 
Omet fsoecfy) 



2. Whttfc citms do you tftjoy? {lift} 



~ow a- you renavt ,n ^» CJ Listen , Q taom <n ^scuss.ons Q T a * e iot* 

□ Sitae □wntiiettM Q c 00l arounc 

□ Do noting Q Taik to frierws Q Do *cmewor* * 0 r w classes 

sofneminc cmer than class wor*< 

.Vhy- 



I VYhicn dnw do you tot tftfoy ? I fin J 



-ow zz vou 3«nave tn :ntm' 



□ Listen □ ?amc;oate <- discussions Q 7a*e notes 
□Sleeo □ write setters Q ~ 0I 3rcunc 

□ Do notning Q t0 Q Dq nc?Tievv0fK iQf otf|fr . 
,li_j^eag sorremmg etna* man c:ass wcr< 

LJdtnar 'soec!*v» 



counts art vou ta*mq ttits year that you didn't Dm to take? dm) 



0 



J 



Ctm »* Scnoou Svanitttop* 
STUC6NT INTERVIEW ?Q*M 



m it of ipoaaai programs aaailabia at your aehoc4- 



• academic 

1 Ht« you had difficulty with any of thaw subtara this yaar? Q v ^ =roc '*^ 5 

ivirv rfta or oar m wtic you read tnt studias.) 

Hscr* rjsm Q feme* ri=-S.L * □ Corecsmor □ *aac 



1. Doaa lomaotia in tha prooram halp you w«ih any of thasa subjacts? 
8. Havt you parvapatad in any of tha f ollowtno? 



RlirrvtfCt'nr ] 2 3 



c 



vioua* tuior-rg attar jct.coi 



3*5 



2 3 * 



1 iScf; a; «n«c'a» ***c 
I ww ■»er**wcric 1 2 3 4 



1 In oanarai, ara you dotna battar or wpfta m your school work this yatr than lasx yaar? 

Q Battar Q] No Changa Q Worw Q Othar tspactfy) 



10. Jaopia moitty talk about thraa lands of probiams That studants ha*a in school- 

f 7?»ay ao not go to dmm-rhey cut c/jbjk, art /art, or do /»or *vtn coma r<? icnoo/. 
2 77?av ma*t rrou^a /or ma men** m dast* 

J 7*ty aar m trouo** m ma Aa//* snd around m* xhoot~!ik$ gtntng mxo fights, or 0*tng frgh a// th* r/ma. 
Aoout hew many rimatirttnaofst fawmontnihaya you A0c-:3"ca -cswt i-'ct ai-osx 

N*«ve* w»rCiv *vf • * p »0«** • ***** tyrv q«v 



r 

Skipoac scnooi 1 



Cutaatt 

Arrival iatt for en 



i 



11, What do you do whan you *fcip achoo4, cut daw, or ara lata? 

B3 4f s - O ^jc -.vr ^ia«5s cr> sence 1 jrounfis Q *ac .v~ **-a*3s sr-oc; grouses 

S-3«§ i ^carara [j ngn Q Q ^ c ^2CC:-c 

s c .- ? . - f . //1t * jtr*-encSOVf arc Q St,v " ! ° r,t T " ' vattr " V D Srav nc "* f :c ca0vSi! 

r~ i *^tc A / ._ -- — * 



12. About how ottan m tha oaat raw month* ftava you . . 



5aan m trouo^a in cim for fooung around 
Had anorv aroumants witn taacnars 
Had anorv aroumams with otnar ttuoants 
3atn ^<gn ki xnoot 

Had fjonti at scnooi 0-17 



l i I l 

i t 
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Ctwi m Scaoii fv*u#t»o* 

STUOf NT INTlHVIfW «C*M 



13. Hwt your pno twtn caiiad mtti dttopltnary naartna. with tha pnnespu ma yaar? 
itxDiort rtafcni. outcomes, ro*i of CIS stvrf. if tooiiaoiej 

✓ I 1 N«vr f 1 Oner or twtct l L ^ j Mort man xnrtc nm« 



14, Haw you baon nnpawoad from aJ*uo< tfm yoar? 

^txoiort "*«oni. aucomt. ro*t or CIS szarf, it nbiicao'iJ 



□ 



Onct or rwict 



□ 




Mori man tnrtt time 



15. Did you dro© out of tcftool tt any unw tfm yaar? FH v w ["J No 

ttxaion r«$ons for crcsomg out, motivation for Ttum) 



• PARTICIPATION IN EXTRACURRICULAR AND ENRICHMENT ACTIVITIES 
16. What do you usually do atnr jenootf Whara do you MsuaJly 90? 



17. Would you- RATHER ba acMmj tomatftin* at» attar softool? 



NO 



* *nai 7 



IS. Hart a t Ust a* icttvitias that STUdanra lomtumtj do rftar scftooj or on waafcamfe. 
Whicn onri ftavt you dona ft) tna tar: yaar? 



^•sr*. csrs ifcwaoaii. tttJ 
Anrio « o*av 
D^nc 3*^as 

~nt"= iscra tvents 

-r:s~c szec.ai avants ,e*TC-3. »tc: 
I-,.:2=C* *»criit:»n acuities 
aner^i* r:tv 

v s * a^uir*'*'** SarKS 

C^«T" Jcr^maj icictr >cur^ £rou*j 
N€-cr-ro"occ **e-*at;ert ac^vmes 



Who «am? ftimnv fna«oi. scnooi . C!SJ 



er|c 
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Cifes ■« Schools evaluation 
ST J DENT INT*SV»£>V 



19. Do vou ever want to parti ape ti in somt of these activities out can't? I I Ves I I No 

n .vn\ :.v : /cu' £j r. e3 , t ^ orccie 1 " Q Cnnc care "53- onsic Mines l! -Vasr * nvitec 

1 S^ciovme": £J p * r E""» tstncrons Q Not *«oucn tscxets 
LOtner {soecV , 



• PEER GROUP 

20. How many of the other students in your group of 10 art good friends/ 
How many art there in this group that you can't gat alone with at ail? 



2t. How would you oatcnb* yourself in terms of the way you gat along with other kid*? 

I -ave on>v a *ew # nencs Q Acout averaoe Q c -tenai»er man averaoe Q Usuaiiv out ;o»nc 



^ -ave on>v a *ew # nencs m -*c 

| .Van* # c ce arouse cecci* J Or; 



ner 'aescrice* 



22. Hai anybody you know wail dropped out of school? 



.Mo 



* f ~ace vcu s*av m scr-oot 



. --*cr /our 5 i$t9- iccc * r <e"3. acquaintance, ctne'? , 



• EMPLOYMENT 

Have you had a pert-time job this year? f ] No I 1 ParM--* 1 1 S- — *" 



it \ Z • Cv - 0 r 



a 0' *»r*c octa*n reasons i 



24. Have you made arrangements for a summer job this year? 

0 v «i nave been hired 

0 in me process of aooiymg 
□ No 

if so wnat will vou oe doing? 

What die you do to acpiy* 



3ia CIS staff neio witn arrangements' How? 

1 25 , 



f you have not yet made arranoements for a summer job, do you plan to get one? ~] v * 5 j [ m 0 
2^. Oo vou pian to finish Nigh school? j } v « [ J Nc 



27 If ves. what dn vou plan to do when vou finish hign schooP 




\ 



Cues m Seneoit Cvawetton 
STUDENT INTE^VifW.^OHM 



28, What can you do in high school thai wilt help you rtach thss goei? 



Q T * lk -o or ogram staff 
["1 T 8>ct courses >n me fieic 

PI 2o voiuntaa" wor* tn me f*#c 
Q Vint rocai oustness office 
| U ^Ofi : Know 

29. How did you decide on this future? 

PI "aifceo :o carwr rounsator 
f") c amous oecoie m ma news 
[]0w isoacifv 



~** k t0 guidance counsator 
Q Visit coHeoa or vocational scnooi 
Q Wnta for information (catalogues, aoohcations) 
Q Tafce entrance examination (i.e.. SAT) 
Q Otnar (soeciryi 



[J cxamola among family or fnenos 
n Raao aoout it (wfKra?) 



[J TV/radio/ movies 



30. 



PI Heard about it m class 

I. Is there someone around your neighborhood you would tike to ba like? [[^Yes ["Up 
wno 7 Amat sots he/she co ? Why ao you want to ba nka mat oerson* 



• CRIMINAL JUSTICE CONTACTS 

31. Have you bean healed by the police this year? Q NeV Qonca or twtcevJQ Mora nan mree times 
-c^ec: .ncaent— wnat nao caned, wno was involved, Outcome) V\ 



32. Have you done anything ageinst the law and not gotten caught this year (Le., shoplifting vandalism)? (lyes I I 
oe$C"cect*anse) U-J 



No 



33. HevtyVou been sant to court this yaar? Y* 1 1 No 



34, Have you bean on probation this yaar? fives fl 



No 



/•S vnv ' 



dim m Scnoon fvetuetso* 
STUOINT iNTMVitW *0*M 



• INTERACTION WITH CIS STAFF 
35. WW* which program staff member do you spend the most time? 



Whv> 



Ifv ever 



36. About how often each week do you see 

When* (chack atl mat aooiv* | [ Dunne scnooi hours [_J After scnooi Weekends 

37. Hmi you talked to program staff about any of These topics since tha school yaar began? ^] v es £H No 

!f vas. »ndicata wnicn :cotav J"l scnoot worn Q teacner srooiems £j oersona* urcoia^s 

- EH attendance Q home rrooiems Q droooing out c? scnooi 

f| just talk * £H money orootems Q otne r texoiain) 



Probe for dataifc about ona of tha topics checked 



3S. Has anyone from tha program visited your home this year? 



**eouencv 



No 



Nature ©f visit 



• BEHAVIOR CHANGES 

39. Do you act in the follow? ways mora than last yeer, lest then test year or 
about the same? 



a. Comotete scnooi assignments 

b. Pay attention m c\m 

c Bead for pleasure 

a Panic i pete tn extracurricular 
activity fa.g., ciuoi taams) 

a. (Set men at school 

f. Make new fnenos 

P'ooe for ex am oi ea, a ascriptions of eacn activity 



Abour the 

More than Lass than same as 
last year last yaar last yaar 



ERLC 
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C\tm m $eno&% Ivamatio* 
STUOINT iNTHVlfW *0*M 



STUDENT CRITIQUE 



4a What do your fritm* outiidt tfta pro-am thmk about it? 



41. What do you think tha program if supposod to do? 



4Z What do you think you 8©t out of it? 



43, What do you think of tha proof am? 



44. Do you want to ba m it naxt yaar? Why? 



er|c 



17 1 

B-22 



Chm m Scnooti lv*u«eon 
STUOtNT INTf "IVIfW *0*M 

*i«*cnotm *0 No. _____ 
INTERVIEWER NOTES 

a. Honesty of ruoonse 

at*" 

b Observes neaith/medical orcoiems 



c. Ctner ocservations (i.e., oovious recent 3fug or aicohoi use, hostmtv, fatigue) 



z. What came across to vou £unng the interview tnat we might miss 
'rem reaamg the resoonses to tne seoarate Questions 7 




172 




CITIES IN SCHOOLS 

STUDENT POST-INTERVIEW RATING SHEET 

(fill out or* tor me* student after tnt tnttrvwwi 



Student ID No. Interviewer 



Ttll me at wnat point these kinds of behev»or become a problem for students your age 



ATTENDANCE; If a student is eheant about . 

□once every I — It day I — 1 2 days I 13 days I \*or more 
few weeks LJaweek i la weak I — la week I — Idaysaweek 



VERBAL ABUSE If a student often ( a few times a weak) . . 

ORSTAF?f* Hltalksbeck toa rHullo beck to a teacher I"""] something beyond 

I I teacher using LJ using dirty language. I — I screaming such as 

dirty language ' making threats, pushing or shoving 

screaming, etc the teacher 



AGGRESSIVE- A student often (a few times a weak) . . . 

TOWARD ri threatens | — I pushes I I starts I I starts reaJ I I starts fights 

OTHER LJ other stu- Uother LJ minor LJ fights (fists, LJ end often 

STUDENTS: dents (not students fights la but someone brings* 

mfunl around few blows) usually gats w ea pon (pipe, 

hurt) bottle, etc) 



DRUGS AND A student gets high at school . . . 
ALCOHOL; 

□once every | — la few rn almost I I almost every 

few weeks LJtimes a l_J every day LJ morning and stays 
week for part that way for the 

of the day rest of the school day 



DELINQUENT 
BEHAVIOR: 



A student . 



□is committing 
minor offenses 
for which he/she 
could get arrested 
(petty shoplifting, 
venoalism, etc) 



□is not violent, but is 
committing offenses 
that would be felonies 
for an adult (burglary, 
shoplifting expensive 
goods, etc.) 



□ is committing 
violence-related 
offenses (battery. 
purs**natching, 
robbery, etc.) 



L-24 
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Gtttt in Srtoo* eviction 
STUDENT IHTf PtVIIW *OBM 



Gty, 



Component 



POST-TEST 
ATTITUDE 



R e spo nd ent ID No 



1 Oo vou believe mat most orobiems will solve themselves 
if you just don t fool with them 7 



RESPONSE 
{circle yes or no) 



Yes 



No 



Am you often Warned for things that just aren't your fault 7 


Yes 


No 


Do you feel that most of the time it doesn't Day to try hard 
because things never turn out right anyway 7 


Yes 


No 


Oo you feel that most of the time parents listen to what 
their children have to say? 


Yes 


No 


When you get punished, does it usually seem it s for no good 
reason at ail 7 


Yes 


No 


Most of the time do vou find it hard to change a friend's mind? 


, Yes 


No 


Oo you feel mat it's nearly impossible to change your 
parent's mind about ar ✓thing? 


Yes 


No 


Oo you feel that when you do something wrong there's 
very lime vou can do to make it right 7 


Yes 


NO 


Oo you believe that most kids are just bom good at sports 7 


Yes 


No 


Oo you feel that one of the-best ways to handle most problems 
is iust not to think about them? 


Yes 


NO 


Oo you feel mat when a kid your own age decides to hit you, 
There's i«tt*e you can do to stoo htm or her 7 


Yes 


No 


Have you felt that when people were mean to vou »t was 
usually for no reason at ail? 


Yes 


/ No 


Most the time, do vou feel that you can change 
whet might haooen tomorrow by what vou do tooay 7 


Yes 


No 


Oo you believe that when bad things are going to haooen 
they just are gomg to happen no matter what you try to do 
to stoo them 7 


Y« 


No 


Most of me time do vou fino it useless to try to get your 
own way at home? 


Yes 


No 


Oo vou feel that wnen somebooy your age wants to be 
your enemy mere s little you can do to change matters? 


Yes 


No 


Oo you usually fee* that you have little to say about what 
you get to eat at home? 


Yes 


No 


Oo vou feel that »f someone doesn't like vou there s little 
vou can do aooit <t 7 


Yes 


No 


Oo you usually fee* mat it's almost useless to try m school 
because most other children are just plain smarter man vou are 7 


Yes 


NO 


Most of me time, do vow fee* tha\ vou have uttle to say scout 
whet vour f amny decides to oo? 


Yes 


No 


Art vou me King sf oerson wno be^eves that planning 
aneec ms*es mings turn out better? 


ves 


No 
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EXHIBIT B.4 



Cities in Schools Evaluation 
Teacher Interview Form 



Cit y _ Component Teacher I.D. No. 

Se * _____ Age Interviewer 



o Introductory Remarks 

" You *" * member of an independent evaluation team doing an assess- 
ment of the Cities in Schools Program. 

- You are interviewing teachers, selected randomly from the faculty, 
to discuss the impact of the program on the school and the students , 



- All answers are strictly confidential 

Are you familiar with a program called Cities in Schools operating 
in this school? No Yes 

Under what circumstances have you observed the program? 



4, 



2. From what you have seen or heard, how would you describe the program? 



(Probe for perceived objectives, description, activities, outcomes.) 
3. what kind of students seem to be chosen for this program? 



Have you ever recoonended that a particular student be included in 

the program? No Yes If you have, what problems were they 

having? 1 



Do you see the program making changes in these students? {I.e., 
academic improvement, differences in school behavior, self-esteem) 
Mo Yes Describe: 



In your opinion, has the program had a positive effect upon the 
stuaents? No Yes If yes, how? 



Have there been any; negative effects on the students? 53 Yes" 

If yes, what are they? " — 



5. Are tnere any ways in which CIS has made your job easier? No 
Yes If yes, how? * 



6. Are there any ways in which CIS has made your job harder? 
2to Yes II yes , how? 



7„ Any other side effects? 



8. In your opinion, how important is this program to the students it 
serves? 



9. If you had money/ what kind of special program' would you develop at 
this school? (Probe for objectives, activities , student population.) 



10. In your opinion, how much communication is there between CIS staff 
and the teaching faculty? 



What has been the nature of the communications? 



11* Do you have any suggestions for improving the program? 



12. Any other observations? 



O f T 
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INSTITUTIONALIZATION QUESTIONNAIRE — SCHEDULE B 



DIRECTORS , DEPUTIES OP SOCIAL SERVICE A GENCIES , 
AND COMMUNITY-BASED ORGANIZATIONS (STARRED ITSMS) 



1.* What is the n at ur e of your agency's relationship with CIS? 

Staff have been a • signed to work at a school, as part of CIS. 
Plans to assign staff to a CIS project have been collated. 
Plans to assign staff to a CCS project are being developed, 
the agency is making inquiries about CIS. 
None 

Other (describe) 



2. Briefly describe the procedure your agency uses in choosing <4iirh 
staff members are assigned to CIS. 



3. How are staff who are assigned to CIS paid? 

Federal funding only 
Matching funds (describe) 



Agency funds only 
Other (describe) 



4. By what means does your agency maintain contact with staff assigned 
to CIS components? 

Informally, as needed. 

through periodic memos or reports from assigned staff. 

Other (describe) 
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5a. Bow would you characterize your agency 1 s current position on 
the CIS project? 



(1) the agency is prepared in principle to assign personnel 

to the pr o gram on a permanent basis* 

(2) She agency approves of CIS as a program, but is unlikely 
to assign staff without continuing Federal subsidy, 

(3) __ She agency is taking a wait-and-see approach. 

(4) __ The agency is not favorably impressed by the CIS program. 

(5) to opinion* 

(6) Other (Describe) 



5b. [If 6a is answered by "1" or "2", ask 5b J Have you or staff 
designated by you publicly taken a position on the CIS project? 

__ Visited the CIS site. 

Spoke at a meeting or public gathering (Describe) _____ 



__ wrote letter (s) or article (s) on behalf of CIS. 

Encouraged other agencies to obtain information on CIS. 
__ Encouraged other agencies to assign staff to CIS. 

7.* Could you comment on your own assessment of CIS? 



8.* What future would you predict for CIS? 



What is the basis of your prediction? 
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5. Has Z~Z participation atfected the way that your agency does its iob? 
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SERVICE 0EH7ERY QOESTXONNAIRE— SOCIAL SE5VIC2 STAFF 
In CIS* now many students are on your caseload? 
Abour how many of them do ycu talk to daily? 



EXHIBIT B.6 



A 



About how of ran do you talk to any one student (besides saying hello)? 

once a once a wee^ every few weeks 

... monthly o ther 

Please take a look at this list of places where counseling may take 
place. 

A. % of instances 3 ^ Duration of 

Session 

At a student's home 

Away from school, but not at home 

At appointoents in the office 



At appointments somehwere else at 
* :hool (e.g., lunchroom) 

Unplanned encounters during the 
school day 



100% 



In Column A, place an estimate of the percentage of your counseling 
that oce:irs at eacn place. In Column a, indicate how much time you 
usually spend witn a student. 

About how often did you talk tc client? 

- once a -ay once a week ever'/ few weeks 



men ml y othe: 



Agency wnere previously assigned 

location (e.g., central office, storefront, branch office, etc. 



How large was your agency caseload? 



About now many or tnese clients did ycu talk tc daily? 



loO 
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10. Please read over the following items, and for each one indues. tie 
(by a cneck in the appropriate space) how your agency experience 
and CIS experience compare. 

Agency Agency Agency CIS CIS 

much somewhat and CIS somewhat much 
better better same better sette 

Access to client 

Time spent in direct contact with 

clients 

Career prospects 

Development of my professional 

skills 

Support services from the 

administration 

Knowledge of the client's 

real needs and resources 

Availability of help from 
other staff 



Positive impact of your work 
on the client 



One tenet of the CIS philosophy is that the program will be able tc 
families through contact with the student at school. Have you 
found this to be true? 



reacn 
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How would you compare your work at tr.e agency and ar CIS with regard 
co tne problem of burring ou:? . 



4 



L3- What is* the most important disadvantage of working out of the 
school rather than out of the office where you worked before? ^ 



14 , What is the most important advantage of working out of the school 
rather than out of tne of f jce where you worked before? 



Overall, wnere would you prefer to work _f you had to cnoose 
berweer. CZS and your agency's central office? 
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Do you stiil feel that you are peter of your agency? 



How do you deal with the two supervisors—the CIS program manager and the 
agency supervisor? 




Site 



I nterv I ewer 



Interview Form 
Data 



EXHIBIT BJ 



Asm 



on5N30<ns 

Project History 



1 nterv i ewee 



Title/ agency 



ne 



Name 

Relationship to Cities in Schools - 

(Role, length of service, dates) 

Note to Interviewers . 

e AIR will areoare the manuscript; your primary respcnsibi ! i ry is to 
gather as mucn information as you can%bout the history of the project. 

• Key data sources will be the project archives and personal Interviews 
with key actors throughout the project development/ 

e References to people, events f decisions etc. should be well documented 
with information such as agency affiliations, aates, reasons for 
decisions, the decision makers and so forth. 

e Request copies of any documents, reports, correspondence, archival -ma- 
terials of potential value in assembling the history* 

* e Gather lots of examples of the Interviewee's experience or observations 
related to the project. These can be situations which occurred with 
the students, staff members, soonsors, parents. We can ieern a lot 
aoout the project through anecdotal accounts and they'll contribute to 
a more interesting narrative* 

• Don't be bound by this outline. It is designed to cover the basics but 
* ?s prcsac ? y more exclusive than inclusive; let trie interviewee talk 

aoout tl-ie program. We have a lot to learn. 



The curl Ire selcw briefly summarizes the contenrs on the following Dages* 



Introduction 
Developing the Project 
The Or i c \ na I ^r^gr^m 
Early Suooort 

!U. Getting Started: The r irst Year 
Se^ — i ng 'Jo rne p ~ocr*m 
^-ooiems anc Changes 
£y^luat**crs and ^eacTions 

Zc'Tl rsuaticn 
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Items ma 
Zzl lect 



rked with an ceteris* snculc Drovise coocnun tries for sucn examples, 
tc*** negative and oositive si"uet:ors. 
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introduction. Make a brief statement about the origins of the pro jeer. 




( Induce antecedents of the project here end/or elsewhere) 

*. 


It. 


Developing the Project. 




A. The Original Program. 


* 


* I. Why was tne project started i.i thfc city? 




2. To what extent was the Idea* for the project initiated here and/or 
elsewhere? 




3 . Who were the key actors recu I red to estab 1 1 sfc the 
project here? 




* 4. What local conditions stimulated this city's interest in Cities in 
Schools? (or whatever else called earlier) 




5. Describe the design of the early project. 
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6. What were the long-range goals at the beginning of the project? 



7. Were there any first year objectives stated at the outset of the 
project? 



8, Early Support. 

♦ !» Describe tne role, nature and exrent of involvement, expectatfons 
of the following early supporters- 



School 

superintendent 

Youth service 
agencies 

Bus i ness 
cc p au nity 

Local com- 
munity 

O^her 



2* On funding* Try to obtain the following. 



Role 



Nature and extent of 
i nvo I vemenT 



Expectations 



Mayor 



Sources souanr 



Why? 



Degree of success 
in col iars 



ponrl nuartpn 



ERLC 



L-37 



Ill* Getting Starred: The First Year 

A. Setting Up the Program, (Description of the first implementation) 
I. On school selection. 



Name of school 



Grade level 



Whv selected 



2. On student selection. 
Type of stuoafrts 



How selected 



Approximate nurnper 



3. On staff set action. 

Source (where come from) 



How used 



Selection crfreria 



4. Describe the administrators of the program e. g. who and why? 



5- Agency part ici par ion. 
Name of aoencv 



Nature and extent of 
i nvo I vement 



Whv selected 



6. Li st rne func'ngs sources anc ~ne approximate amount supp i : dv eac* 
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7. Describe how the program was sat up* 



* 8. Describe some of the major activities during the f irsl" year. Note 
spec If !c successes and fa i I ures . 



3* Problems and Changes. 

* I. Describe any differences between the proposed project and the one 
which became operational. 



# 2. Identify problems encountered in establishing the project. 



* 3. What changes were made as the year progressed? Why? 



C* evaluations and Reactions. 

I. If an evaluation was conducted, state whaT changes were made as 
a resulr, CCoMecr relevant documents) 



* 2. Describe the rssoonse of the parr! cipants, oarenrs, community mem- 
bers, stakeholders and others to The program. 
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IV, P-ojec* Continuation . Use on* of these forms for each of the subseouent 
years to the presenr. 



Year 2 



Year 3 



Year 4 



Year 5 



Year 6 



A. Describe changes in the project between the previous year and the one 
checked aoove. 

f. Expansion of the project. 



2. Reduction of the project. 



3. Organizational set up. 



4. Personnel . 



5. Agencv par*ic? oat ion. 



6. Funding sources - 



Studen* codecs**' on. 



eric 
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Were there any new and/or dtHarant relationships among the princi- 
pal actors, agencies, sponsors etc? If so, please describe. 



What obstaclas arose during this year? Did any of the old ones dis- 
appear? How wars thasa obstaclas addressed? 



Were thara any changas in ttia focus of tha project a. g. long and 
short tarm goals? What wara they and why did they change? 



Describe some of the major activities during the year. Note soecif tc 
successes and fa i i u res . 



Describe the resoonse of nonschoc! parrfcioanTs and/or observers Ccom* 
munity, parents, orher srakehoiders) . 



tier* *ners any eve iuar tons. If so, state wno, wnen, hew and why? Tfha* 
*es cJone ss a rasult of tha conclusions? 



Other coranerrts offered by the Intervi ewee • 



Use this space for recording examples. 



er|c ^ 



Cities in Schools Project Histories 
i. Some suggestions to help m developing the histories: 

^l\,t? w J LI - WriCe ? P Che ^w^" «o >^u can concentrate on getting 

SET w " ad noc worry abour the 

Basic sources of information will be: 

1. project archives 

2. talking to the people who were involved at the time. 
Please include wherever possible 

1. names, titles, agencies of all persons mentioned 

2. dates for all events 

3. for every step that required a decision : 

a. who made the decision 

b. for what reasons 

At every interview, you should ask for copies of any documents 
archival material, reports to sponsors, correspondence, etc. that 
you or the interviewee think might be useful to us. 

Narrative and anecdotal accounts: Interviews often result in 
interesting and revealing information that does not seem to fit 
directly into any section of the outline. Please do include with the 
notes you give us incidents interviewees relate to you. (Readable ' 
interview notes will be fine.) 

2. Brief outline 
Introduction 

I- Developing the Project 

A. The Original Program 

3. Early 5upnort *~ 

i-* ue"mg 5 Z3xz scl «The First Year 

A. Srt zing it Up 
5- Prooias ind Changes 
- ' il^azicns/ reactions 

^eco.-u: fear— Changes and Expansions 

• sar —Changes and Expansions 
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3. Expanded outline with questions . 

*atroduction-*a brief statement of when the uroject was started or how 
lojj^. it has been going and what it is ail about. 

I. Developing the project 

A. Ihe Original Program 

the project started here in this city? 

2. To what extent wns the* project developed here and to what 
extent was it an idea brought from elsewhere? What were 
the antecedents of the project in this city? in other 
cities? 

3. Who was involved in getting the project started in this 
dity? 

4. Why d6 you think this city was receptive to the Cities in 
Schools idea? Were there specific local problems that were 
of major- concern? 

5. What were the long-range goals at the beginning of the 
• project? 

6. What were the first year objectives at the tine the project 
was being formulated? 

1 / 7 - Wha* ciid the project look like when it was first proposed? 

B. Early Support 

1. Whose support was sought to get the project going? 

a. mayor '.s office 

b. school superintendent's office 

c. principal youth-service agencies 

d. any other important groups (e.g., business community) 

2. What was their reaction? What was the nature and extent of 
their involvement? What were their expectations of the 
project? 

3. What was the role/reaction/ expectations of the local 
community? ^neighoorhood) 

4. Where was funcing sought? Why? With what success? '.mere 
did first funding -ome from? 
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'II. Getting Started— Tne first Year 

A. Setting iz Up — Describe the program as it was first implemented 

1, School selection— which school (s), why was it (were they) 
selected 

2, Student selection — how many students were involved, how 
were they selected 

3* Staff selection— what was the staffing pattern, what were 
the selection criteria 

4* Administration— who became administrators, why 

5. Agency involvement— which agencies, exact nature of their 
commitment, why they were selected 

6. Describe the actual set-up (e.g., students were divided 
into families of with staff ) 

7. Budget breakdown; amount of money from each funding source 

8. Describe some major activities of the fir$t year 

B. Problems and Changes 

1* How did the program as it was set up differ from the 

proposed program prior to implementation? Why? ____ 

2. What other problems were encountered in getting started? 

3. What changes were made as the year progressed? Why? 

C. Evaluations/Reactions 

1. Was an evaluation done? If yes, attach report, memoranda, 
or other products • Was anything done as a* result of the 
conclusions.? 

2. What was the response of participants, community , other 
stakeholders? 

Ill* The Second Year 

A. What happened to the project? Were there changes? Expansion? 
Components dropped? 

B. Describe the program set-up for this year. 

C. Name the new people and agencies involved this year. 

D. Was there a T new/di£ferent relationship among the principal 
actors, agencies, funding sponsors? Describe the new roles. 



eric 



E. Were there changes in the focus of the project? In the long- 
range goals?' Ia*he obj ectives..fer___ehis year? What were the 
changes? Why did they change?' 

F. Were old problems amelioraTed? Did new ones arise? - 

G. Give figures for second year. 

i 

1. Student/staff characteristics by component 

2. Budget breakdown by component and source 

H. Describe some major activities/accomplishments during the year 

I. Were there any evaluations? By whom, when, what was looked at, 
conclusions, what was done as a result of, the conclusions? 

J. Reaction of participants, community, other stakeholders 
IV. The Third Year 

For each subsequent year (if any) run through the questions in 
part III again. In that way we can get an historical picture of 
the project on a year -by-year basis. 
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EXHIBIT B.8 




Stuoani Sirthoctt . / 



I. IDENTIFICATION 

A. Citv: 1 » At'aiTO 
icircit one; 

2 • tndwnaoota 

3 • Naw Yont Ctv 
3. Cornoon«nt \*\\\ m scnooi n«m«t 
C A.'R Stua«m 10 No. , ft? 
D. Scnoo* Svntm io No.. « { 



£. Grid* in Scftot*. 1978 * 79 (jwnta numotr 01-12) ? ■ ■ 

F, CIS Family <40) twrtn m ntmt of family grouo laaoar] 
I 

G - CIS Family 1 1 0) f ca a a l o a o : wrrta in nama of M manaoat i: CM 10 No. 



- i 

H. Dm jomao CIS. 

fnomn yw 
L Still in pr ogram it and o^ywr:_vw *'~ w 

t* no. datt itft GS - _ * 

montfc yw # 

ftaaaon for Withdrawing tcirttt onat ^ 

1 • Graduation 

2 * GEO 

3 ■ want nac tnxo rtouiar moot program at 

jnorrnr KfK»i 

^ * MovtOtwwyr 

5 ■ him t r am s 

6 * Unknown ^ 

7 • efTHWpymtm 

8 ■ Arm«d tarvicts 
■0 • Lost Inttrwi 
*1 * ^-agnancv 

* 2 * ?imny proof ma _ 

u *E^o**o 

Otnar ttPOejfy) , 
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II. PERSONAL INFORMATION j SataSowrca 

a Ract. i * Siac* 3 • * booth: 

2 • whita 4 * Otnar 

8, *oma >-fngii$n 3 • Snofitn/Soantan 

tjnguaor 2»Soanitn 4 -Otnar 

Z. Sax. ' • Maia 2 • **twa 

0. Sytoanea of Maotc* Prooiami <circia ih tnat aoo'y) 
X • no information 
0 • nona «w>grca isao'iai nonai 
" * snytieat nanoicao 

2 ■ cnronic tlinau: 

3 ■ "wnucrnion 

4 * fMR/taarmra atsadiitrv 

5 • 7ru9/atconoi ait 
9 * naar may ytnon ion 

# » omar toaacnoaf . 1 QO . 
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Ctv 

Csmoontnt 

AIR Stuoam lO no, 

Stuaam (0 No 



II. PERSONAL INFORMATION (continutd) 

£. £vto*nc» of Hnottonn Scrattat 
teirete tit truit aocivi 

X • no information 

0 • nont tsourct io«cifi*$ norm} 

1 • vtoitm. acting out 

2 ■ faasuant toti of wnor 

3 * uncoooarativ* 

4 • tacxs fnanas 

5 * cmr {Qfl«^&»i 



r. Stuaam u an u i wd param? 

X • no mfo * Mill ion 
0 - No 
> • Yes 



Stuaam nat so«ci*i rmo iarae til tnn tooivr 

X • no information 

1 •bttfTte*et 

2 - luncn ticxat 

3 * tcnooi feat 

4 • otfier ioeacnbe)' . 



H, Student net too 7 

X » no information 

0 • no 

1 * oart-itme Cunnq tcnooi year 

2 * Jummer too 

3 • bom Dart-time dunng scnoo* ano aummar job 



Coaer riw« ideecrtoe any i n c o n ea flen ci e t in 



III. SCHOOL INDEX 

A. Time in scnoo* tcsreje onej 

• 1 * Enteric at beginning of veer 
2 • enttrec liter ffill m aate> 



Reeeon for it* entry JCifcta oriel 

1 • taatonai erruHovment £ * i ncafceraf ejd 

2 « i^naas . 5 • omar Hoeofy/ 

3 • fee* ot iiotnm^ 

* 4 « tie* of monav 



« 1 • ftnuned icnooJ vaar 

2 * wimdrew r-om jcnooi 
(fill in dates 



TrarrtTa* i ed from 
tnotnaf tftooi 




S. Reawn for witno rawing t a reft onei 



' * graduation 
2«G£2 

3 ** w*nt oacK nto neegitr tcnooi 

4 « movec twav 
§ ■ 'nofctfttad 

** ■ emo,ovr»e*tt 
. S * Mresecrservicss 
tf} ■ ioit 'nttratt 
' * « sr agnancv 
«2 * 'tmiiy prgoiami 
i3«neeiffi 
u-aaoetiea \ 
1 5 • otnar (ibacitvt - 



©fbcracn tt anotner asnooi 



B-48 



19 



'Gty 

Comoonant 
AiRScubtntiONo.. 



Student Sirmoact 



IV. FAMILY INFORMATION 

a, uv« wim x • no information 

1 ■ ootn natural own 

2 • om mturU oarant m nao paranx 

3 ■ singt* omm family 

4 • iivflt aiona or w»tn siblings 

(notosrantj - 
" 5 • irv«f with othar aOOit tlitivt 

6 • Uvos mn\ parson otnar man ra4ativs 

7 • QtTW «-iK«^ 



Data Sourct 



3 Si«» of *imi*y. 

X ■ no information 
Numor of ii&iings 



Otnor oaooia »n horn* Hist rttptiontntoi 



Totai rtuflW of DOOM raguiartv 
!,vmg tfl horns. 



C education mm of fatnar: ♦ 

X ■ no information 
• * «/«• SCftOO* 

2 * torn* hqn tcnooi 

3 * graouatao from nicn tcnooi 

4 • soma ctf faga/taenmcat training 

5 ■ f ininsnao pott mgn scnool training cow 

(not 4-yaar coitagsi 

6 • trwOuMtwa 4-yaar coffaoa 

7 ■ oosr graouata 

3 * unknown 

D. eOuqtion irw^ or mother ' 

X ■ no infomation * 

1 ■ grot tsKiot 

2 • soma ntgn lcnopl 
3^gnQu«ia from nign scnooJ 

4 * to** cwfaat/taermicai naming 

5 • 'tninsnoo Dost nion Kf*oo< turning count 

-not 4-v«r coings> 

6 • 3**ouatac 4. vaar col i SO* 
?N » ocst grscuixs 

3 » jiwnown 



Occupation o* ntdfsi o* touaanvic: 



e tmtr or matt 

Mom#f of ftw w n 



IOC 



c gmoiavma-v tlftUS of r**d of nousanotd 

X * no information 
* * faguitf.v tmoiqvao 

2 • Ttmoorafiiv wnamoioyao 

3 ■ cncoDtcJuv urwnotovao 

^ ■ not saoKtng v«ft Out pnviieaMv to it to wor* 

i« oiMOtao 

3 * ?!*#r <OMtnO«J 



EMC 
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Ctv _ 
Comoontnt _ 
air S:uoem ID No.^« 
Stuaent Sirr^aate _ 



IV. F/WILV INFORMATION (continued* 

G. income »evei of family 

* - 'as man S5.000 otr veer C 
2 - S5 ,000- SI 0.000 
3- Si 0.000 -SI 5.000 

4 ■ mort mm 515 000 

5 • other toe»cr»bei 



D*ta Source 



H. Type c? financial asssance recssvec bv tf» family 
■circle «u that aooivK 



X ■ no information 

0 ■ none 

1 « AlP)OC 

2 * Socm Security 

3 ■ OtsaCititv/workman $ ccmoensation 

i. rjmuy situation *circtean t net eOCM 
X ■ no information 

1 ■ oarent &nv«ai iffnesa/incaoecitatec 

2 • parent •motional fry jnstao«e 

3 * gertnt arug/ eieonoi aouse 

4 - sioiinois) orucyelcono* aouse 

5 * M»wt involved in cnm»nj< activities 

5 • sibling* si involved in criminal activities 
7 > unwed ttbiingts) nave cnitoren 



5 * unemDJOvmant comoensaxion 
8 ■ Stare Suoowmenrei income 

7 • Food Stamos 

8 • Medicaid 
10 • Otner 'specify) 



Oescnoe eacn orooiem circieav 



> 



. Socrai Service neeos of tne family (circle ait tnat sooty}: 

0 ■ none (form states tftere ere no service neede) t 

■ * emoiovment 3 * onjo/asconoi treatment 

2 • income assistance i 0 • ciaming 

3 • meoicai/oentai cere H • *eoa4/crimtnei justice 

4 • food ramos 12 « 
5 -Housing I3*4*iftdi 
6 * cm tocare/daveare 1 4 • oreonencv counseling 

1 - mentai neaitti/counseting 15 * otner .specify j 



Der'itit eacn neeo circted: 



K. is me student Title XX eiigioie?. 



.ye 



K CJS RECORDKEEPING .eroeone^ 



ZlS s iie s mutiny most or tne information 

to cr"nr>itTf ?n* *o«n 

C'S c m* « mi»wr9 soma or ma information 
:o comoiftt mis 'O'r* 



3 .'a mi \m a misfing oniy 4 
comeiete mis ?orm 



to 



*5oer -emarKf «aescnoe osoj inconsistencies/ 
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At 

/ Arch 



CITIES IN SCHOCS 

Archive* 0«li/1978*79 



Ctv 



Component 



AIR Studem 10 Nc^ 
^rudem Sirtnaay t_ 



(J NO 



! s there 3ny rtcorolsi en cisc:oi?nary actions for this stuoem? 
• if "Yes", complete Section V for each action: 
V. Dt SCI PU NARY ACTIONS AT SCHOOL .fill cut one for aacn jncioent Seiween 1975 and 1978) . 

Data Source 



• Numoer of dayi of disciciinary action x. 
Cocer remam i a ascribe oata mconnnancais) . 

















i /vi informsTion 

1 1W 11 •• Wl 1 • ■J**W1 1 










1 AlfTtfM fM 111 










» truancy 










1 disrupting class 




1 




4 - 


i fignting 


A* 




* 


5 - 


1 drugs 








o ■ 


vexDai souse o* teacners 


























^ nvfxjiso oy 


* ■ 


no information 




— 

/ 
/ 




i ■ 


dean 








^ ■ 


teecner 






• 


3 « 


CIS staff memoer 








4 - 


pnneoai 






• Parentei 


X * 


no information 






notification. 




parents came to scnooi 








2 ■ 


parents called 








3 - 


parents sent note 








4 ■ 


no parental notification 








5 - 


otner <descr.be): 






* Action taken 
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Qty 



Component 



AIR Student ID Nc. 
Stuoent Birrnaav l. 



VI. ATTENDANCE 



!. -Hi tn number of davs absent usin$ me smaller* period of time 
recorded (semester. Quarter, six times oer year) however often 
me school records it 

\ST 2nd 2rd 



1975-77 

1977- 78 

1978- 79 



4m 



oth 



6th 



Total Data Source 



1 Fill m numoer of ctesses cut (same time periods as m Item t . above) 

1 ** 2nd 3ro 4tn Sth otn 

1976-77 



1977- 78 

1978- 79 



Coaer remarks (describe data inconsistencies). 



Total Data Source 
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City 



-omoontnt 



AIR Student *D>jo 
Stuoeni Sinnaay 



VII. GRADES 



A t rill m grade points or graaas for each marking panoo in 1978-79 and 
the final grace pftm avaraga. 



GPA 

Reeding 01 

$o«ilmg 02 

Literature 03 



Social 
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xion/Haaitn 32 
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Data Source 



9 

ERIC 



4 
5 

6. 

7, 
3, 



14 



b-53 202 



A 

/ Arch 



C1T! 65 IN SCHOOLS 

Archival Dita/1 978-79 



Ctv 



Component 



AIR Student ;0 No, 
Stuoent Birtnaay. l_ 



VII. GRADES (continued) 



C Fill m final graces tor itch subject listed for 1 977-78 ana 1976-77 and 
• graae do hit average for those years. 



1977-78 
rina* Grade 



1976-77 
Final Grade 



GPA 

Readmg 

Spelling 

English/ 
Literature 

Social Studies 

Math 

Science 
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only) 
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Yor* only! 
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27 
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Data Source 
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womoonent . 



AlB Stuotnt ID No. 
Student Sinnody 

VIII. TEST SCORES-1976-79 . * 

Scan wftn most recent score first anc 90 oac* to test three sets i years; of test scores. 
Record: name of test: date often: suotest cooe* ana score. 

* Subtest code*. 1 • Reeding 5 • Vocabulary 

2 ■ Language 6 * Soeed /accuracy 

3 « iVtoth 7 ■ Total battery 

4 * Compreheniion 



Set 1 

Ten Name 



.Date. 



Sec 4 

.Test Name. 



.Date 



Code* Gc Percentile Raw Score Data Source Cooe* GE Percentile Raw Score Data Source 



! 



Set 2 

T«n Name 



.Date- 



Ten Name' 



.Date. 



Code* GE Percentile Raw^ Score Data Source Code* GE Percentile Raw Score Data Source 



I 



Set 3 

Te$t Mane 



,Date: 



Set 6 

.Ten Name: 



.Date 



Code* GE Percentile Raw Sccre Data Source Code* Gc Percentile Raw Score Data Source 
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IX SCHOOL 8EHAV10« / ATLANTA CONOUCT GRADES 



City 



Compontm 

AIR Student ID No. 
Studtnt Sirtnoay. i 



Class 1 
Cass 2 
Class 3 
Class 4 
Class 5 
Clause 
Class? 
Class 3 
Homeroom 



Pail 



Winter 



Sprtig 



Average 



Oaia Source 
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IX SCHOpL BEHAVIOR / INOI ANAPOUS CONDUCT 



Ctv 



Component 



AIR Student ID No. 
Stuaam Birthday, l 



A. Amtudinaf Grades 

Cheerfulness 

Coooeration 
Courtesy 
DeoendaOility 
industry * 
bjaoership 
Punctuality 
. School Interest 
Study Jiaoits 

3. Teacher's Rating 
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Poor 
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Compontm 



• COMPONENT if in ift om for eacn component in wmch AIR is coilacting data) 



r tH m total numor of scnool da vs. using int smaMast panod of timt raeordac 
tsamtixtr, auanir, six urrm par year) . howavar oftan ma scnoot rtcoros it. 
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Qbs«rv«r Baport Pora 



EXHIBIT BS 



Gbstmr: 

Data: 

Tint 
locations 
Staff Prasant: 



Studants ?raaant (if claaaroou obaarvation, racord tha mabar of rtudants 
in attendant and tha maibe tardy) : 



Daacription: 



(CSS l/d/7f) B " 61 



Th* rt^Kt « authonzfd by law (20 y&C. Whilt you 

*t* rtquirtd to respond, your coopt ration \% needed to 
»m« the results of this survey comprehensrv*. tccurate, and 

timely, 

0MB Form No.51-R-l2S4 

Expiration Date 30 August 1980 * 



EXHIBIT B.10 

CITIES IN SCHOOLS EVALUATION 



fit 



Case Manager 
Interview 
Fprm 

P0S T -TEST / Scheoule B 



Cty 



Component 



Giso Manager 
Grade 



Case Manager I D No * 



Sex 



1. What do you think CIS has accomplished this year? What it your 
opt n ton of tht program? 



2. What art some of the problems the program has encountered? 
How would you attempt to solve them? 
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EXHIBIT B.11 

CASEWORKER INTERVIEW FORM 

POST-TEST 1980 



City Component 



Caseworker - i, t Caseworker ID No. 

Grade Race Sex 



4 

1. | What do you think CIS has accomplished this year? What fs your 
opinion of the program? 



How would you rate the overall impact of the program on the students 
this year? Circle one* 



Program had 
no impact 



Program had 
a slight 
positive 
impact 



Program had 

moderate 
positive 
impact 



Program had 
a major 
positive 
impadt 



Why did you circle that option? 



3. Were you a caseworke^ in 1978-79? 

Yes No 

If yes, how would you rate the effects of the CIS program on the 
students this year as opposed to last year? 

Worse No Change - Better 

Why? 
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What are some of the problems the program has encountered. 
How would you attempt to solve them? 



21 i 



E-64 



